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FROM THE EDITORS 


Dear Scientific American Reader, 

The philosopher Bertrand Russell, author of that majestic treatise Principia Mathematica, once 
wrote, "Mathematics, rightly viewed, possesses not only truth, but supreme beauty—a beauty cold 
and austere, like that of sculpture, without appeal to any part of our weaker nature, without the gor¬ 
geous trappings of painting or music, yet sublimely pure, and capable of a stern perfection such as 
only the greatest art can show." That intimidating, transcendent beauty, as much as any practical 
applications, is what has drawn people to the study of mathematics for thousands of years. Plato 
theorized that our impermanent world was merely a shadow of a deeper reality filled with unchang¬ 
ing ideals that could be grasped only through exercise of reason. What could do more to bring that 
universe into view than the abstract perfection of mathematics? 

I still remember my first encounter with a Mobius strip. Disbelieving the description in a book, I 
quickly cut a strip of paper, gave it a half-twist and sealed the ends—and felt stunned to see that 
it did indeed have just one side and one edge. No artifact left behind by space aliens could have 
blown my 11-year-old mind more. My fascination soon led me to discover other wonders like Klein 
bottles, four-color map theorem and, of course, Fermat’s last theorem. Today, decades later, my 
actual mathematical competence is sadly deficient but my love for mathematical concepts is untar¬ 
nished. 

These math-related articles from Scientific American are consequently some of my favorites. They 
examine some of the enduring puzzles that have challenged us since at least the time of the an¬ 
cient Greeks, and reveal how mathematics reaches deep into the roots of modern technology and 
the very nature of scientific inquiry. And it is wonderful to contemplate how much more there is still 
to ponder. As Henry David Thoreau put it, “We have heard much about the poetry of mathematics, 
but very little of it has yet been sung." 


Sincerely, 



John Rennie, editor in chief 
Scientific American 
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Doron □. Swade 


John L. Casti 


Historians have argued that Charles Babbage was unable to 
build his vast mechanical computers because his concept 
tion exceeded the capacity of 19th century engineering. 

The construction in 1991 of a working, three-ton calculating 
engine proves that his designs were well within the realm of 
possibility. 


Unsettled by discoveries about the limits of 
mathematical proofs, philosophers have wondered 
whether science can aspire to explain how the 
universe works. The authors proposes that science 
unshackled from mathematics might be able to 
tackle even the ultimate questions. 


June 1995 


The Arithmetics of Mutual Help 


Martin A. Nowak, Robert M. May 
and Karl Sigmund 

When should an individual cooperate with others? When 
does it make more sense to betray them for selfish gain? The 
answers to such questions ripple through evolutionary biology 
and sociology. In computer simulations, strategies, such as 
the aptly named Tit-for-Tat, duel for dominance. Achieving 
the right balance among altruism, forgiveness and treachery 
seems to be the key to victory. 


November 1994 


Resolving Zeno’s Paradoxes 


William I. Mclaughiin 

Can a turtle outrace a swift-footed demigod? Almost 
2,500 years ago the Greek philosopherZeno logi¬ 
cally argued that with a head start it should be able 
to do so and that motion is therefore an illusion. 
Modem mathematics that resurrects the concept of 
infinitesimals finally points to a way out of this bind. 


November 199? 


Fermat's Last Stand 


Simon Singh and Kenneth A. Ribet 

Two years ago Andrew J, Wiles of Princeton University proved 
the most famous unsolved problem in all of mathematics. 
These authors, one of whom made a discovery crucial to Wile's 
argument, trace the attempts to re-create Pierre de Fermat's 
cryptic proof and explain how Wiles succeeded. 


February 199 ? 


The Challenge of Large Numbers 


Richard E. Crandall 

In the third century BX., Archimedes calculated the sum of alt 
the sand grains it would take to fill the then known universe. 
That’s a pretty good-sized number, but it's small potatoes 
compared with mathematicians' ever expanding notions of 
how large meaningful numbers can be. 
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Redeeming Charles Babbage’s 
Mechanical Computer 

A successful effort to build a working, three-ton 
Babbage calculating engine suggests that history 
has misjudged the pioneer of automatic computing 

by Doron D, Swade 


C harles Babbage is celebrated as 
the great ancestral figure in the 
history' of computing. The de¬ 
signs for his vast mechanical calculators 
rank among the most startling intellec¬ 
tual achievements of the 19th century. 
Yet Babbage failed in his efforts to real¬ 
ize those plans in physical form. His to¬ 
nes of computing routinely assert that 
Babbage faltered primarily because the 
demands of his devices lay beyond the 
capabilities of Victorian mechanical en¬ 
gineering. Curiously, no contemporary 
evidence supports that view. 

In 1985 my colleagues and I at the Sci¬ 
ence Museum in London set out to re¬ 
solve or at least illuminate the question 
by building a full-size Babbage comput¬ 
ing engine based on his original de¬ 
signs* Our endeavor finally bore fruit in 
November 1991, a month before the bi¬ 
centenary' of Babbage’s birth. At that 
time, the device—known as Difference 
Engine No. 2—flawlessly performed its 
first major calculation. The success of 
out undertaking affirmed that Babbage’s 
failures were ones of practical accom¬ 
plishment, not of design. 

Those failures have become inextri¬ 
cably associated with his creative ge- 


DORON D. SWADE is both an electron¬ 
ics engineer and a historian of comput¬ 
ing. He has been senior curator of the 
computing and control section of the Sci¬ 
ence Museum in London since 1985 and 
has published articles on cur a tor ship 
and on the history of computing. He has 
recently written two books: Charles Bab¬ 
bage and His Calculating Engines, which 
accompanies the Babbage exhibition that 
Swade curated, and T in collaboration with 
Jon Palfremail. The Dream Machine: Ex¬ 
ploring the Computer Age t a companion 
to the television series of the same name. 
Swade led the project to construct a full- 
scale Babbage calculating engine. 



CHARLES BABBAGE sat for this daguer¬ 
reotype around 1847, the year he began 
work on Difference Engine No. 2. 


nius. Babbage, proud and principled, 
was famed for the vigor and sarcasm 
of his public denunciations of the sci¬ 
entific establishment. The demise of his 
engine project added a sense of injus¬ 
tice, bitterness and even despair to his 
celebrated diatribes. Since then, he has 
acquired an image of testiness and ec¬ 
centricity'; the first biography of Bab¬ 
bage, written by Maboth Moseley and 
published in 1964, was titled Irascible 
Genius; A Life of Charles Babbage t Inven¬ 
tor : Our work at the Science Museum 
emphasizes a distinctly different side 
of Babbage: a meticulous inventor whose 
designs were hugely ambitious but well 
within the realm of possibility. 

Babbage’s desire to mechanize calcu¬ 
lation arose from the exasperation he 
felt at the inaccuracies in printed math¬ 
ematical tables. Scientists, bankers, ac¬ 
tuaries, navigators, engineers and the 
tike relied on such tables to perform 
calculations requiring accuracy to more 


than a few' figures. But the production 
of tables was tedious and prone to er¬ 
ror at each stage of preparation, from 
calculation to transcription to typeset¬ 
ting. Dionysius Lardner, a well-known 
popularizer of science, wrote in 1894 
that a random selection of 40 volumes 
of mathematical tables incorporated 
3,700 acknowledged errata, some of 
which themselves contained errors. 

Babbage was both a connoisseur of 
tables and a fastidious analyst of tabu¬ 
lar errors. He traced dusters of errors 
common to different editions of tables 
and deduced where pieces of loose type 
had been incorrectly replaced after fall¬ 
ing out. On one occasion, he collaborat¬ 
ed with John Herschel, the renowned 
British astronomer, to check two inde¬ 
pendently prepared sets of calculations 
for astronomical tables; the two men 
were dismayed by ihe numerous dis¬ 
crepancies. “I wish to God these calcu¬ 
lations had been executed by steam f” 
Babbage exclaimed in 1821. 

Mechanical computers should, Bab¬ 
bage thought, offer a means to eliminate 
at a stroke all the sources of mistakes in 
mathematical tables. He envisioned a 
machine that not only would calculate 
flawlessly but would eradicate transcrip¬ 
tion and typesetting errors by automat¬ 
ically impressing the results of its caL 
culations onto papier-mache strips or 
plates of sofl metal. A printed record 
could then be generated directly from 
those plates, thereby eliminating every 
opportunity for the genesis of errors. 

In 1822 Babbage built an experimen¬ 
tal model intended to carry him toward 
his goal. He called his mechanical cal¬ 
culator a “difference engine 11 because it 
is based on a mathematical principle 
known as the method of finite differ¬ 
ences. The method permits one to de¬ 
termine successive values of polynomi¬ 
al functions using only addition \see 
box on page 8\. Multiplication and di- 
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vision, which arc far more difficult Lo 
mechanize, arc not necessary. Because 
the value of the function at each step is 
calculated based on its predecessor, a 
correct final result imparts a high de¬ 
gree of confidence that all previous val¬ 
ues are also correct. 

For economy of design, Babbage's dif¬ 
ference engines use the decimal number 
system rather than the binary system 
common to modem electronic comput¬ 
ers, Each digit in a multidigit number is 
represented by a toothed gear wheel, 
or figure wheel, engraved with decimal 
numerals. The value of each digit is rep- 
resented by the angular rotation of the 
associated figure wheel The engine's 
control mechanism ensures that only 
whole-number values, represented by 
discrete positions of the figure wheels, 
are valid. Babbage boasted that his ma¬ 
chines would produce the correct result 
or would jam but that they would never 
deceive. 

Babbage’s most ambitious venture to 
construct a full-scale calculating device 


was devoted to the ill-fated Difference 
Engine No, 1. His efforts foundered in 
1813 after a decade of design, devel¬ 
opment and component manufacture, 
not to mention vast expense. The proj¬ 
ect collapsed after a dispute between 
Babbage and his chief engineer, Joseph 
Clement, over payment for relocating 
the machining works. Outwardly at 
least, technology did not feature in the 
disagreement. The question that has re¬ 
mained tantalizingly unresolved is 
whether the circumstances surrounding 
the collapse of the project concealed 
the technical or logical impossibility of 
Babbage's schemes. 

D ifference Engine No. ] consists 
of a basic adding element, re¬ 
peated many times over in an 
arrangement that embodies the meth¬ 
od of differences. The size and com¬ 
plexity of the engine are monumental: 
the design calls for roughly 25,000 parts; 
the assembled machine would measure 
eight feet high, seven feet long and three 


feet deep; and it would weigh several 
tons. The project, which was funded by 
the British government, was also enor¬ 
mously expensive. When Clement’s last 
bill was paid in 1834, the cost totaled 
0 7,470. For comparison, the steam lo¬ 
comotive John Bull, built in 1831, cost 
all of 1784. 

Clement completed about 12,000 of 
ihe 25,000 parts required for Differ¬ 
ence Engine No. 1, most of which were 
later melted down as scrap. The British 
government finally withdrew from the 
project in 1842, partly on the advice of 
George Biddell Airy, Astronomer Roy¬ 
al, who pronounced Babbage’s engine 
“worthless " The failure to complete the 
difference engine w r as the central trau¬ 
ma in Babbage's scientific life; it is a top¬ 
ic he returns to repeatedly in his wait¬ 
ings as though unable to reconcile him¬ 
self to the dismal outcome. 

The years of work on Difference En¬ 
gine No. 1 did produce one noteworthy, 
tangible result, in 1832 Clement assem¬ 
bled a small section of \ he engine, con- 



DIFFERENCE ENGINE NO. 2 was constructed in public view at some essential adjustments. Babbage also designed a print- 
the Science Museum in London. Here the two engineers who mg mechanism for the difference engine, but because of lim- 
built it, Barrie Holloway (te/t) and Reg Crick (right >, perform ited time and money, Ihe printer has not yet been built. 
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sisting of about 2,000 parts, as a demon¬ 
stration piece. This finished part of the 
unfinished engine is one of the finest ex¬ 
amples of precision engineering of the 
time and works impeccabiy to this day. 

The demonstration piece is the first 
known automatic calculator. Unlike the 
desktop calculators of the lime, the en¬ 
gine, once set up, did not rely on in¬ 
formed human intervention. Thus, an 
operator could achieve accurate results 
without any understanding of the logi¬ 
cal or mechanical principles involved. 
The opportunity' to speculate about ma¬ 
chine intelligence was not lost on Bab¬ 
bage and his contemporaries, Harry 7 Wil- 
mot Buxton, a younger colleague with 
whom Babbage entrusted many of his 
papers, wrote that “the wondrous pulp 
and fibre of the brain had been substi¬ 
tuted by brass and iron; he [Babbage] 
had taught wheelwork to think." 


Despite its impressive capabilities, the 
difference engine could perform only 
one fixed task. Babbage’s reputation 
as a computer pioneer largely rests on 
another, more sophisticated device— 
the Analytical Engine, conceived by 
1834. He intended the Analytical En¬ 
gine as a general-purpose programma¬ 
ble computing machine, whose features 
are startlingly similar to those of mod¬ 
ern electronic computers. It had a basic 
repertoire of operations {addition, sub¬ 
traction, multiplication and division) 
that Lt could execute in any sequence. 
The internal architecture of the machine 
Featured a separate “store" and "mill,” 
equivalent to the memory and proces¬ 
sor in a modem computer. The separa¬ 
tion of store and mill has been a domi¬ 
nant design feature of electronic com¬ 
puters since the mid-1940s. 

The .Analytical Engine could be pro¬ 


grammed by using punched cards, a 
technique previously used in the Jac¬ 
quard loom to control patterns of woven 
thread. The Analytical Engine could take 
alternative courses of action depending 
on the result of a calculation, enabling 
it to perform complex functions, Bab¬ 
bage intended the machine to be able 
to handle up to 50 -digit input numbers 
and 100-digit results; the output could 
be printed, punched or plotted. 

Although historians customarily re¬ 
fer to the .Analytical Engine as if it were 
a physical thing, it is actually a series 
of unbuilt designs that Babbage refined 
at intervals from 1834 until his death 
in 1871. Demoralized by the fate of 
Difference Engine No. 1, he made no se¬ 
rious attempt to construct a full-scale 
Analytical Engine, A small experimen¬ 
tal part of the mill that was still incom¬ 
plete at the time of his death, along with 


How Babbage’s Difference Engines Work 


S hown below is one of Babbage's 20 main drawings of 
Difference Engine No, 2, which he drafted In 1847. The 
machine is operated by means of the handle on the right. 
Turning the handle rotates a vertical stack of 14 pairs of 
cams that determine the action and timing of the calculat¬ 
ing cycle. Numbers are stored and operated on in eight ver¬ 
tical columns, each of which contains 31 engraved figure 
wheels. The least significant digit of a number is stored at 
the bottom of the column, the most significant digit at the 
top. The initial values for a calculation are entered by un¬ 
locking the figure wheels and rotating each one by hand to 
the appropriate decimal value. Below the figure-wheel col¬ 
umns are a set of racks and levers that, when activated by 
links from the cams, lift, lower and turn the vertical axes. 


thereby carrying out the addition of differences. Difference 
Engine No. 2 does not add numbers in sequence from right 
to left, as one might expect. Instead values from odd-num¬ 
bered columns are added to even-numbered columns dur¬ 
ing the first half-cycle; even-numbered columns are then 
added to odd-numbered columns during the second half- 
cycle. This technique significantly reduces the time required 
fora calculation. A similar approach, known as pipelining, 
is used in modern electronic computers. The printing 
assembly, located at the left, is directly coupled to the last 
column of figure wheels, which bear the final result of the 
calculation. Each turn of the handle produces one 30-digit 
value in the table of differences and automatically prepares 
the machine to generate the next number. 


PRINTER 
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WORKING PART of Difference Engine No. I T assembled by Joseph Clement in 1832, 
is the first known automatic calculator. Its flawless operation strongly supports 
Babbage’s conviction that building a FttU-sizcd engine was a practical prospect. 


another fragment later built by Bab¬ 
bage's soil, Henry Prevost Babbage, are 
the only significant remains of his grand 
designs. 

Work on the Analytical Engine forced 
Babbage to think about how to develop 
mechanisms capable of automatic mul¬ 
tiplication and division, all regulated by 
a complex control system. The solutions 
to those problems inspired him to de¬ 
sign a simpler and more elegant differ¬ 
ence engine, Difference Engine No. 2. Al¬ 
though the machine calculates to a pre¬ 
cision of 31 figures, 10 digits more than 
Babbage envisaged for Difference En¬ 
gine No. ! t it contains only one third as 
many parts. Babbage drew up detailed 
plans for the second machine between 
1847 and 1849 and offered them to the 
government in 1852 but received no 
encouragement. So things stood for 
nearly a century and a half. 

During several visits to London begin¬ 
ning in 1979, Allan G. Bromley of the 
University of Sydney in Australia exam¬ 
ined Babbage's drawings and notebooks 
in the Science Museum library and be¬ 
came convinced that Difference Engine 
No. 2 could be built and would work, f 
had independently read of Babbage's 
hapless Fate and become deeply puz¬ 
zled as to why no one had tried to re¬ 
solve the issue of Babbage's failures by 
actually building his engine. 

T n 1985, shortly after my appoint- 
I ment as curator of computing, Brom- 
JLley appeared at the Science Muse¬ 
um earning a two-page proposal to do 
just that. He suggested that the muse¬ 
um attempt lo complete the machine 
by 1991, the bicentenary of Babbage's 
birth. Bromley’s proposal marked the 
start of a six-year project that became 
something of a personal crusade for 
me. The saga of our effort to construct 
the difference engine is one worthy 
of Babbage himself. We embarked on a 
complex engineering project that took 
us into unknown technical territory and 
confronted us with mechanical conun¬ 
drums, funding crises and the intrigues 
inherent in any major venture. 

Difference Engine No. 2 was clearly 
the engine of choice for the project. The 
associated set of drawings is intact, 
whereas those for Difference Engine No. 
1 show regrettable gaps. Difference En¬ 
gine No. 2 is also a more economic de¬ 
sign. Cost and Lime constraints argued 
in favor of ignoring the printer and con¬ 
centrating on the rest of the engine. The 
printer is composed of about 4,000 
parts and would be a sizable engineer¬ 
ing project in its own right. 

The documentation for Difference 
Engine No. 2 consists of 20 main de¬ 
sign drawings and several tracings. As 


we pored over those drawings, my col¬ 
leagues and 1 discovered several flaws 
in the plans, in addition to those iden¬ 
tified by Bromley. One major assembly 
appears to be redundant. Other mecha¬ 
nisms are missing from the design. For 
example, ihe initial values needed to be¬ 
gin a calculation arc entered by unlock¬ 
ing the columns and manually rotating 
each of the freed figure wheels to the 
appropriate positions. Babbage omitted 
a means of locking the columns after 
they w f ere set, so the setting-up proce¬ 
dure was self-corrupting. 

The most serious design lapse con¬ 
cerned the carriage mechanism. This 
crucial component ensures that if, in the 
course of an addition, the value on a 
figure wheel exceeds 10, then the next 
higher figure wheel (indicating numbers 
10 times larger) advances one digit 
The most extreme test of the carriage 
mechanism occurs when a 1 is added 
to a row of 9’s. Babbage solved the car¬ 


ry problem in an exquisitely innovative 
manner. During the first pari of the cal¬ 
culating cycle, the engine performs a 
31-digit addition without carrying the 
lO's, but every figure wheel that ex¬ 
ceeds 10 sets a spring-loaded warning 
device. In the second part of the cycle, 
each armed warning device allows a ro¬ 
tating arm to advance the next higher 
figure wheel by one position. 

Unfortunately, the configuration of 
the carry mechanism shown in Bab¬ 
bage’s design drawings is unworkable. 
The direction of rotation of the figure 
wheels is incorrect, and the w ? arning- 
and-carry mechanism could not func¬ 
tion as drawn. The source of these short¬ 
comings stimulated considerable spec¬ 
ulation. We considered the possibility 
that errors w ? ere introduced deliberate¬ 
ly as security against industrial espi¬ 
onage. More likely, some flaws were de¬ 
sign oversights, and others were inevit¬ 
able drafting and layout errors. 
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None of the design problems we found 
in Difference Engine No. 2 compromised 
Ils overall logic or operational principles, 
and we managed to devise solutions for 
all. Unnecessary mechanisms were omit¬ 
ted. The missing locking assemblies for 
the figure wheels were devised and, 
where necessary, their motions derived 
from those of neighboring pieces. Brom¬ 
ley solved the carry-mechanism problem 
by mirror-reversing the incorrectly drawn 
parts and altering their orientation. The 
introduction of a four-to-one reduction 
gear in the drive allayed skepticism about 
whether the massive Difference Engine 
No. 2 could be driven by hand. This 
change made the drive handle four times 
easier to turn but caused the engine to 
run four times slower. 

implementing the solutions raised a 
significant philosophical dilemma. Could 
we make these alterations without com¬ 
promising the historical authenticity of 
the result and, with it, the mission of 


proving that Babbage’s engines were log¬ 
ically and practically sound? We solved 
this problem by adhering to Babbage’s 
own design practices and strictly con¬ 
fining ourselves to techniques or de¬ 
vices available to Babbage. We also 
planned the revisions to Babbage's de¬ 
sign so that every mechanism we added 
could be easily removed. 

I n 1989 we built a small trial assem¬ 
bly at the Science Museum to verify 
the logic of the basic adding ele¬ 
ment and to confirm that the carry 7 
mechanism operated correctly. The as¬ 
sembly adds a two-digit number to an¬ 
other two-digit number and takes ac¬ 
count of any carry' from units to tens 
and from tens to hundreds. The finely 
Finished device went a long way toward 
convincing sponsors and colleagues diat 
our project involved an engineering aes¬ 
thetic as well as an intriguing historical 
thesis. The trial piece later proved an 


Mathematical Principles of the Difference Engines 

B abbage's difference engines are so called because they use the method of 
finite differences to find the value of certain mathematical expressions. 
The method is used below to produce the table of cubes (y = x 3 ). The first dif¬ 
ference is found by subtracting successive pairs of cubes. The same procedure 
is applied to pairs of first differences to derive second differences. When the 
process is repeated for the second differences, one finds that the third differ¬ 
ence is constant and equal to six. This information makes it possible to gener¬ 
ate the rest of the table of cubes by reversing the differencing procedure. For 
example, adding six to the second difference (1 8) gives the new second differ¬ 
ence (24); adding this to the first difference (37) yields the new first difference 
(61). Finally, adding this to the last cubed number (64) gives the next number 
in the sequence, 125 or 5 3 . The procedure can be repeated indefinitely to gen¬ 
erate as many terms as desired using only repeated additions. 

The method of differences can be applied to any of the mathematical func¬ 
tions known as polynomials, which have the generic form y=a rt x n + 
a n- i x "" 1 + - ■ + a \ x + a o- The difference of an nth order polynomial 
will always be a constant that can form the basis for the method of differenc¬ 
es, Polynomials are used to represent many relations in physics and engi¬ 
neering. They can also be used to approximate other functions, such as loga¬ 
rithms and trigonometric functions. In Babbage's difference engines, each col¬ 
umn of figure wheels represents the position of one multidigit number in the 
table. Difference Engine No. 2 can tabulate 7th-order polynomials to 31 fig¬ 
ures of accuracy, an impressive accomplishment even by modern standards. 


FIRST SECOND THIRD 

DIFFERENCE DIFFERENCE DIFFERENCE 



invaluable aid for visualizing ihe ma¬ 
chine’s operation and for testing the first 
sample parts. 

To build Difference Engine No. 2 and 
to estimate the cost of manufacturing 
it, we needed full-dimension drawings of 
its parts. Late in 1989 we contracted a 
specialist engineering company to pro¬ 
duce a set of drawings using Babbage's 
original set as the authoritative source. 
Missing information—detailed dimen¬ 
sions, choice of materials, tolerances, 
methods of manufacture and a great 
deal of fine detail—had to be supplied. 

Dimensions for the individual parts 
were obtained by measuring and scal¬ 
ing the original plans. The engineering 
company produced 30 new 7 drawings 
that fully specified each of the engine’s 
4,000 parts. Surviving mechanical as¬ 
semblies show’ that Babbage construct¬ 
ed his parts from bronze, cast iron and 
steel. Bromley and Michael Wright of 
the Science Museum offered advice re¬ 
garding which material to use for each 
part. Our colleagues at the Imperial 
College of Science and Technology ana¬ 
lyzed the composition of the compo¬ 
nents of Difference Engine No, 1 to guide 
us in selecting an appropriate modern 
bronze. 

No attempt was made to use period 
machinery in the manufacture of parts. 
The engine’s 4,000 components embody 
only about 1,000 different part designs, 
so there is a high degree of repetition. 
We unashamed ly relied on modem man¬ 
ufacturing techniques to produce the 
many identical parts. We also welded 
parts that Babbage would have forged. 
But we scrupulously ensured that Bab- 
bage could have produced components 
of the same precision, though possibly 
by other means. 

Specifying the precision with which 
parts should be made proved less prob¬ 
lematic than we first feared. Bromley 
and Wright bad measured parts from 
Difference Engine No. 1 and found that 
Clement achieved repeatability of 1.3 
to 2.0 thousandths of an inch, belying 
the popular belief that mid-19th centu¬ 
ry mechanical engineering lucked the 
precision necessary for building Bab¬ 
bage’s devices. We adopted a modern 
engineering standard, confident that it 
was within the limits of what 19th-cen¬ 
tury craftsmen could achieve. The pro¬ 
cess of producing the 30 modern me¬ 
chanical drawings took about six months 
and was substantially complete by Jan¬ 
uary 1990. 

We were determined to secure a fixed- 
price contract for manufacture and as¬ 
sembly so as not to repeat Babbage's 
sorry tale of open-ended expense. Af¬ 
ter some hard negotiation, the Science 
Museum and the specialist company 
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ENGINEERING CHALLENGES wore solved in ihe course of build to verify the design of the engine's basic adding element. They 
ing Difference Engine No. 2. Engineers at the Science Museum also built 210 intricate bronze levers (right, shown atop a de¬ 
constructed a part of the calculating mechanism {left ) in 1989 sign drawing) for the carriage mechanism. 


agreed to a price and to a set of provi¬ 
sions to cushion against unforeseen 
technical difficulties. The Science Muse¬ 
um committed to underwrite the costs 
against pledges from a group of five 
sponsoring computer companies: ICL, 
Hewlett Packard, Rank Xerox, Siemens 
Nixdorf and Unisys. 

Then, in June 1990, just as the final 
contract was about to be signed, the 
company involved wont bankrupt after 
35 years in business. Reg Crick and Bar¬ 
rie Holloway, the two engineers on the 
Babbage project, w r ere fired on Thurs¬ 
day, June 7. Unless orders were placed 
with contractors by close of business 
ihe following day, we would incur cost 
penalties and have to embark on an¬ 
other round of financial negotiation, 
which would have jeopardized our goal 
of completing the project in time for the 
Babbage bicentenary. Officials at the 
Science Museum interviewed Crick and 
Holloway on the morning of June 8; by 
lunchtime they were museum employ¬ 
ees. We spent the day frantically writ¬ 
ing out part orders for subcontractors 
and drafting contract terms. At 5:30 
p.M. f I sprinted to the post office to 
mail the drawings and orders to the 
component manufacturers. We made 
the deadline by minutes. 

Difference Engine No. 2 was built in 
public view in the Science Museum. Fit¬ 
ting and assembly commenced in No¬ 
vember and was completed in May 1991« 
The engine became the centerpiece In 
the exhibition Making the Difference: 
Charles Babbage and the Birth of the 
Computer , which opened on June 27, 
1991. Even then, the project kept us on 
tenterhooks. The three-ton Difference 
Engine No. 2 had not yet performed a 
full calculation, and it kept jamming 
unaccountably. We developed debugging 


techniques to track the source of the 
jams and continued to work on the ma¬ 
chine during the exhibition. On Novem¬ 
ber 29, 1991, less than a month before 
Babbage's 200th birthday, the machine 
completed its first full-scale successful 
calculation. It produced the first 100 
values in the table of powers of seven 
and has functioned without error ever 
since. The engine ended up costing just 
under 000,000 ($ 500,000). 

O ur project illuminated several 
aspects of Babbage's skills as a 
designer and engineer. Histori¬ 
ans of technology have debated wheth¬ 
er the high standards of precision that 
Babbage demanded were necessary or 
were the product of misguided perfec¬ 
tionism. Some researchers have point¬ 
ed out that cruder engines had been 
built to good effect. Georg and Edvard 
Scheutz, a Swedish fathcr-and-son team 
who were inspired by an account of 
Babbage's work, built three difference 
engines, mostly of their own design. The 
first of these, completed in 1843, had a 
wood frame and was made using sim¬ 
ple hand tools and a primitive lathe. 
Despite its comparatively rough con¬ 
struction, the Scheutzes’ machine per¬ 
formed successfully before the Swed¬ 
ish Royal Academy. 

Babbage's difference engines were 
larger and more sophisticated than 
those attempted by the Scheutzes, how¬ 
ever. Our experiences constructing Dif¬ 
ference Engine No. 2 underscored the 
importance of exacting standards. We 
had expected that repeat parts made 
using computer-controlled machines 
would be sufficiently identical to be in¬ 
terchangeable. This proved not to be the 
case. Fine tweaking of components to 
tolerances of no more than a few thou¬ 


sandths of an inch proved necessary, 
especially for the proper operation of 
the carry mechanism, Babbage's insis¬ 
tence on high precision was evidently 
based on sound engineering judgment. 

Constructing Difference Engine No. 2 
revealed subtleties and ingenuity in Bab¬ 
bage's design not immediately evident 
in the drawings. The project also gave 
us tremendous respect for Babbage's 
ability to visualize the operation of com¬ 
plex mechanisms without the aid of 
physical models. We hope to extend our 
explorations of Babbage's elegant de¬ 
signs; to do so, we are currently trying 
to attract sponsorship to build the print¬ 
er. In the mean lime, we marvel at the 
physical realization of plans that Bab¬ 
bage drew r up nearly 150 years ago. Dif¬ 
ference Engine No. 2 stands as a splen¬ 
did piece of engineering sculpture, a 
monument to the rigorous logic of its 
inventor. 
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Computer experiments show how cooperation 
rather than exploitation can dominate 
in the Darwinian struggle for survival 


by Martin A. Nowak, Robert M. May and Karl Sigmund 


T he principle of give and take per¬ 
vades our society. It is older than 
commerce and trade. All mem¬ 
bers of a household, for example, are 
engaged in a ceaseless, mostly uncon¬ 
scious bartering of services and goods. 
Economists have become increasingly 
fascinated by these exchanges. So have 
biologists, who have documented many 
comparable instances in groups of chim¬ 
panzees and other primates. Charles 
Darwin himself was well aware of the 
role of cooperation in human evolution. 
In Descent of Man he wrote that “the 
small strength and speed of man, his 
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want of natural weapons, & c., are more 
than counterbalanced by his...social 
qualities, which lead him to give and 
receive aid from his fellow-men.” 

Obviously, this is a far cry from the 
savage human existence that the phi¬ 
losopher Thomas Hobbes described 
as “solitary, poor, nasty, brutish, and 
short.” Nevertheless, a number of Dar¬ 
win’s early followers emphasized the 
ferocious aspects of the “struggle for 
survival” to such an extent that the Rus¬ 
sian prince Kropotkin felt compelled to 
write a book to refute them. In Mutual 
Aid, hailed by the London Times as 


“possibly the most important book of 
the year” (1902), he drew a vast fresco 
of cooperation acting among Siberian 
herds, Polynesian islanders and medie¬ 
val guilds. Kropotkin was a famous ideo¬ 
logue of anarchism, but his dabbling 
in natural history was no mere hobby: 
for someone bent on getting rid of the 
State, it was essential to show that hu¬ 
man cooperation was not imposed from 
an iron-fisted authority' but had its ori¬ 
gins rooted in natural conditions. 

In a way, his arguments have succeed¬ 
ed far beyond what Kropotkin could 
ever have foreseen. A wealth of studies 
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AMISH ROOF-RAISING in Lancaster 
County* Pennsylvania* demonstrates 
the proclivity toward cooperation 
in this rural society. The Amish 
benefit from a culture that 
champions such forms of 
voluntary mutual aid. 


in anthropology and primatobgy point 
to the overwhelming role of reciprocal 
help in early hominid societies. Text¬ 
books on animal behavior are filled with 
examples of mutual aid: grooming, feed¬ 
ing, teaching, warning, helping in fights 
and joint hunting. In ecology* symbiot¬ 
ic associations are increasingly seen as 
fundamental. Biologists find examples 
of cooperation at the level of cells* or¬ 
ganelles and even prebiotic molecules. 

But at the same time, the ubiquity of 
cooperation seems to have become ever 
more paradoxical. The Russian anar¬ 
chist had failed to see how threatened 
it is by exploitation. What prevents mu- 
tualists from turning into parasites? 
Why should anyone share in a common 
effort rather than cheat the others? Nat¬ 
ural selection puts a premium on indi¬ 
vidual reproductive success. How can 
tills mechanism shape behavior that is 
altruistic in the sense that it benefits 
others at the expense of one's own 
progeny? 

There are two main approaches to 
this question that go under the head¬ 
ings of kin selection and reciprocal aid. 
These concepts are not mutually exclu¬ 
sive, but they are sharply distinct. Kin 
selection is rooted in genetics [see “Kin 
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VARIABLE PAYOFF applies when one, 
both or neither player opts to cooper¬ 
ate. Such point assignments generate 
the classic conundrum or game iheory 
known as the Prisoner's Dilemma. 


Recognition*” by David W. Pfennig and 
Paul W. Sherman* page 98]. If a gene 
helps in promoting the reproductive 
success of close relatives of its bearer* 
it helps in promoting copies of itself. 
Witiiin a family* a good turn is its own 
reward. Bur a good turn to an unrelated 
fellow being has to be returned in order 


to pay off. Reciprocal aid—the trading 
of altruistic acts in which benefit ex¬ 
ceeds cost “is essentially an economic 
exchange. It works less directly than kin 
selection and is therefore more vulner¬ 
able to abuse. 

Two parties can strike a mutually 
profitable bargain* but each could gain 
still more by withholding its contribu¬ 
tion. tn modem society an enormous 
apparatus of law and enforcement 
makes the temptation to cheat resist¬ 
ible. But how can reciprocal altruism 
work in the absence of those authori¬ 
tarian institutions so despised by Kro¬ 
potkin's anarchists? This difficult ques¬ 
tion is best answered by first consider¬ 
ing simple, idealized systems, 

r 1Tie Prisoner's Dilemma 

T o demonstrate the conundrum, Rob¬ 
ert L. frivers, a sociobiologist (and* 
fittingly, a former lawyer), now at the 
University of California at Santa Cruz, 
borrowed a metaphor from game theo¬ 
ry known as the Prisoner's Dilemma. As 
originally conceived in the early 1950s, 
each of two prisoners is asked whether 
the other committed a crime; their lev¬ 
el of punishment depends on whether 
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one, both or neither indicates the oth¬ 
er's guilt. This situation can be viewed 
as a simple game. The two players en¬ 
gaged in it have only to decide whether 
they wish to cooperate with each other 
or not. In one illustration of the Prison¬ 
er's Dilemma, if both choose to cooper¬ 
ate, they gel a reward of three points 
each. If both defect (by not cooperat¬ 
ing ), they get only one point each. But if 
one player defects and the other coop¬ 
erates, the defector receives five points, 
whereas the player who chose to coop¬ 
erate receives nothing. 

Will they cooperate? If the first play¬ 
er defects, the second who cooperates 
will end up with nothing. Clearly, the 
second player ought to have defected, 
in fact, even if the first player cooper¬ 
ates, the second should defect, because 
this combination gives five points in¬ 
stead of three. No matter what the first 
player does, the second’s best option is 
to defect. But the first player is in exact¬ 
ly the same position. Hence, both play¬ 
ers will choose to defect and 
receive only one point each. 

Why didn't they cooperate? 

The prisoners 1 decisions 
highlight the difference be¬ 
tween what is best from an 
individual's point of view 
and from that of a collec¬ 
tive. This conflict endangers 
almost every form of coop¬ 
eration, including trade and 
mutual aid. The reward for 
mutual cooperation is high¬ 
er lhan i he punishment for 
mutual defection, but a one¬ 
sided defection yields a 
temptation greater than the 
reward, leaving the exploit¬ 
ed cooperator with a loser's 
payoff ihai is even worse 
lhan the punishment. This 
ranking—from temptation 
through reward and punish¬ 
ment down to the loser’s 
payoff—implies that the 
best move is always to de¬ 
fect, irrespective of the op¬ 
posing player’s move. The 
logic leads inexorably to 
mutual defection. 

Most people feel uneasy 
with this conclusion. They 
do often cooperate, in fact, 
motivated by feelings of 
solidarity or selflessness. In 
business dealings, defection 
is also relatively rare, per¬ 
haps from the pressure of 
society. Yet such concerns 
should not affect a game 
that encapsulates life in a 
strictly Darwinian sense, 
where every form of payoff 


(be it calories, mates or safety from 
predators) is ultimately converted into 
a single currency: offspring. 

Virtual Tournaments 

O ne can conceive a thought experi¬ 
ment in which an entire population 
consists of programmed players. Each 
of these automata is firmly wedded to 
a fixed strategy and will either always 
cooperate or always defect. They engage 
in a round-robin tournament of the Pris¬ 
oner’s Dilemma. For each contestant, 
the total payoff will depend on the oth¬ 
er players encountered and therefore on 
the composition of the population. A 
defector will, however, always achieve 
more than a cooperator would earn in 
its stead. At the end of the imaginary 
tournament, the players reproduce, cre¬ 
ating progeny of their own kind (defec¬ 
tors or cooperators). The next genera¬ 
tion will, again, engage in a round-robin 
competition and get paid in offspring, 


and so on. In this caricature of biologi¬ 
cal evolution, where the payoff is num¬ 
ber of offspring and strategies are in¬ 
herited, the outcome is obvious: defec¬ 
tors will steadily increase from one 
generation to the next and will eventu¬ 
ally sw amp the population. 

There are several ways to escape from 
this fate. In many societies the same two 
individuals interact not just once but 
Frequently. Each participant will think 
twice about defecting if this move 
makes the other player defect on the 
next occasion. So the strategy for the 
repeated game can change in response 
to what happened in previous rounds. 

In contrast to a single instance of the 
Prisoner's Dilemma, wiiere it is always 
better to defect, countless strategies for 
the repeated version exist, and none 
serves as a best reply against all oppo¬ 
nents. If the opposite player, for in¬ 
stance, decides always to cooperate, 
then you will do best by always defect¬ 
ing. But if your adversary decides to co¬ 
operate until you defect and 
then never to cooperate 
again, you will be careful not 
to spoil your partnership: 
the temptation to cheat in 
one round and grab five 
points instead of three will 
be more than offset by the 
expected loss in the subse¬ 
quent rounds where you 
cannot Tiope to earn more 
than one point. 

The absence of a best 
choice is crucial. There is 
no hard-and-fast recipe for 
playing the repeated Prison¬ 
er’s Dilemma, Success will 
depend on the other play¬ 
er’s strategy, which one 
does not know beforehand. 
A strategy that does w r ell in 
certain environments can 
fail miserably in others. 

in the late 1970s the po¬ 
litical scientist Robert .Axel¬ 
rod, at the University of 
Michigan, conducted round- 
robin tournaments of the 
repealed Prisoner's Dilem¬ 
ma on his computer. The 
E contestants—programs sub- 
| milted by colleagues—were 
S quite sophisticated, but it 
3 turned out that the simplest 
entry ultimately won. This 
strategy Is aptly called Tit- 
for-Tat. It starts with a co¬ 
operative response and 
then always repeats ihe op¬ 
posing player’s previous 
move. 

Remarkably, a player ap¬ 
plying Tit-for-Tat is never 
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REACTIVE ST*RATEGIES for the repealed Prisoner's Dilemma 
can depend on Ihe outcome of the previous round. Four key 
strategies of the 16 possible alternatives are shown (top). Re¬ 
peated rounds of the Prisoner's Dilemma reveal persistent pat¬ 
terns of cooperation ( blue) and defection ( red) when selected 
strategies are paired off during successive rounds (bottom). 
An established sequence may recover or alter after an isolated 
mistaken play (orange). 


12 Scientific .American June 1995 




























JOY SPURR BrvC6 Ci 



COMMON VAMPIRE BATS frequently engage in acts of mutual cattle will share its nourishment with an unfed companion by 
help, A bat that feeds successfully on blood from horses or regurgitating a portion of its stomach contents. 


ahead at any stage of the repealed game, 
being always last to defect. The Tit-tor- 
Tat player can nonetheless win the 
whole tournament, because the Prison¬ 
er's Dilemma is not a zero-sum game: 
it is possible to make points without 
taking them away from others. By its 
transparency Tit-for-Tat frequently per¬ 
suades opponents that it pays to coop¬ 
erate. In Axelrod’s tournaments the Tit- 
for-Tat strategy (entered by the game 
theorist Anatol Rapoport) elicited many 
rewarding rounds of cooperation, w r here- 
as other players, among themselves, 
were apt to get bogged down in long 
runs of defection. 

By winning the round-robin tourna¬ 
ment, Tit-for-Tat obtained more repre¬ 
sentatives among the next generation 
than did other strategies. Moreover, 
those players who had cooperated tend¬ 
ed also to receive more offspring than 
Lhose who had not. With each generation 
Tit-for-Tat shaped a more congenial en¬ 
vironment, The strategies that ruthless¬ 
ly exploited cooperators succeeded only 
in depleting their own resources. 

Unpredictable Adversaries 

W e recently performed computer 
simulations with an extended set 
of strategies that base their next move 
on the result of the previous round 
rather than just the opponent’s previ¬ 
ous move (as does Tir-for-Tat). A strat¬ 
egy’ based on prior outcome must de¬ 
termine the response for each of four 
eventualities: temptation, reward, pun¬ 
ishment or loss. Two possible responses 


for each of four prior outcomes give 16 
possible types of players. 

We further allowed for “stochastic" 
strategies that respond to the four pos¬ 
sible outcomes by changing only their 
statistical propensity to cooperate. Such 
strategies are not obliged to respond 
always in the same way to a given out¬ 
come. One form of stochastic player 
might, for example, cooperate 90 per¬ 
cent of the time after experiencing the 
reward. Such uncertainty simulates the 
inevitable mistakes that occur during 
real interactions. 

The addition of stochastic responses 
resulted in a huge array of possibilities. 
Our computer searched for the most 
successful of these players by simulat¬ 
ing the forces of natural selection, add¬ 
ing to every hundredth generation some 
small amount of a new, randomly se¬ 
lected stochastic strategy. We followed 
many such mutation-selection rounds 
for millions of generations, not because 
the emergence of cooperation needed 
so many iterations but because this 
span allowed us to test a very large 
number of possible strategies. 


In spite of the rich diversity displayed 
in these chronicles, they Jed us invariably 
to some simple, clear results. The first 
is that the average payoff in the popu¬ 
lation can change suddenly. Indeed, the 
behavior we found is a showpiece for 
punctuated equilibria in biological evo¬ 
lution. Most of the time, either almost 
all members of the population cooper¬ 
ate, or almost all defect. The transitions 
between these two regimes are usually 
rare and abrupt, taking just a few gen¬ 
erations. We fotmd that later in the run, 
quiescent periods tended to last longer. 
And there was a definite trend toward 
cooperation. The longer the system was 
allowed to evolve, the greater the likeli¬ 
hood for a cooperative regime to blos¬ 
som. But the threat of a sudden collapse 
always remained. 

Cooperative populations are some¬ 
times dominated by a strategy called 
Generous Tit-for-Tat, a variant that on 
random occasions will offer coopera¬ 
tion in response to defection. But much 
more frequently an altogether different 
strategy, named Pavlov by the mathe¬ 
maticians David R Kraines of Duke Uni- 
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versity and Vivian Kraines of Meredith 
College in Raleigh, N.C., reigns para¬ 
mount. After experiencing a reward for 
mutual cooperation, a Pavlov player re¬ 
peats the former cooperative move. Af¬ 
ter getting away with unilateral defec¬ 
tion, it similarly repeats its last move. 
But after being punished for mutual de¬ 
fection, Pavlov switches to cooperation, 
.And after getting a loser’s payoff for 
unilaterally cooperating, it reacts by de¬ 
fecting. In short, the Pavlov rule says to 
stick to the former move if it earned a 
high payoff (reward or temptation) but 
to switch if the last move brought a low 
return (punishment or loser’s payoff). 
This principle of “win-stay, lose-shift” 
seems to work well in many other situ¬ 
ations, In animal psychology it is viewed 
as fundamental: a rat Is ready to repeat 
an action lhat brings reward, whereas 
it will tend to drop behavior that has 
painful consequences. The same crude 
application of carrot-and-stick underlies 
most attempts of bringing up children. 
Within the repeated Prisoner’s Dilem¬ 
ma game, retaliation after having been 
exploited is usually seen as evidence 
for behavior resembling Tit-for-Tat, but 
U holds as well for Pavlov players. A 
society of Pavlov strategists is very sta¬ 
ble against errors. A mistaken defection 
between two of its members leads to 
one round of mutual defection and then 
back to cooperation. But faced with a 
player who does not retaliate, a Pavlov 
player keeps defecting. This behavior 
makes it difficult for players who always 
cooperate to gain a foothold in the 
community. In contrast, a society of 
Generous Tit-for-Tat players does not 
discriminate against unconditional co- 
operators, This beneficence is costly, in 
the long term, because players w ? ho do 
not retaliate can drift into the popula¬ 
tion and ultimately undermine cooper¬ 
ation by allowing exploiters to thrive. 
Although Pavlov is a good strategy to 
prevent exploiters from invading a co¬ 
operative society, it fares poorly among 
noncooperators. Against persistent de¬ 
fectors, for instance, il tries every sec¬ 
ond round to resume cooperation. In 
Axelrod’s tournaments, Pavlov would 
have ranked close to the bottom. Pav¬ 
lov’s advantages show only after stern¬ 
er, unyielding strategies such as Tit- 
for-Tat have paved the way by steering 
evolution away from defection. 

Innate Cooperation 

O ne can safely conclude that the 
emergence and persistence of coop¬ 
erative behavior are not at all unlikely, 
provided the participants meet repeat¬ 
edly, recognize one another and remem¬ 
ber the outcomes of past encounters, 
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These circumstances may seem familiar 
from daily life in the home or office, but 
among the larger world of living things, 
such requirements demand a high de¬ 
gree of sophistication. And yet w r e ob¬ 
serve cooperation even among simple 
organisms that do not possess such abil¬ 
ities. Furthermore, the strategies dis¬ 
cussed will work only if benefits from 
future encounters are not significantly 
discounted as compared with present 
gains. Again this expectation may be 
reasonable For many of the activities hu¬ 
mans conduct, but for most simpler or¬ 
ganisms delayed payoffs in ihe form of 
future reproductive success may count 
for little: if life is short and unpredict¬ 
able, there is scant evolutionary pres¬ 
sure to make long-term investments. 

But w 7 hat of the creatures, such as 
many invertebrates, that seem to exhib¬ 
it forms of reciprocal cooperation, even 
though they often cannot recognize in¬ 
dividual players or remember their ac¬ 
tions? Or what if future payoffs arc 
heavily discounted? How can altruistic 
arrangements be established and main¬ 
tained in these circumstances? One pos¬ 
sible solution is that these players find a 
fixed set of feilow r contestants and make 
sure the game is played largely with 
them. In general, this selectivity will be 
hard to attain. But there is one circum¬ 
stance in which it is not only easy, it is 
automatic. If the players occupy fixed 
sites, and if they interact only with dose 
neighbors, there will be no need to rec¬ 
ognize and remember, because the oth¬ 
er players are fixed by the geometry. 
Whereas in many of our simulations 
players always encounter a representa¬ 
tive sample of the population, we have 
also looked specifically at scenarios in 
which every player interacts only with 
a few neighbors on a two-dimensional 
grid. Such “spatial games” are very re¬ 
cent. They give an altogether new twist 
to the Prisoner’s Dilemma. 

Fixed in Flatland 

I t should come as no surprise lhat co¬ 
operation is easier to maintain in a 
sedentary population: defectors can 
thrive in an anonymous crowd, but mu¬ 
tual aid is frequent among neighbors. 
That concept is clear enough. But in 
many cases, territorially structured in¬ 
teractions promote cooperation, even 
if no follow r -up encounter is expected. 
This result favors cooperation even for 
the seemingly hopeless single round of 
the Prisoner’s Dilemma. 

Consider a spatially constrained ver¬ 
sion of the tournament, with each mem¬ 
ber of the population sitting on a square 
of an extended chessboard. Each player 
is either a pure cooperator or a pure de- 




NUMBER OF GENERATIONS 


SPATIAL GAMES of the Prisoner’s Di¬ 
lemma display the evolution of a grid 
of players, each of which interacts only 
with opponents in eight adjacent 
squares. The portion of the population 
composed of cooperators gradually 


fector and interacts only with the eight 
immediate neighbors, playing one round 
of the Prisoner’s Dilemma w ith each. In 
the next generation the square is inher¬ 
ited by whoever totaled the most points, 

A lone cooperalor will be exploited 
by the surrounding defectors and suc¬ 
cumb. But four cooperators in a block 
can conceivably hold their own, because 
each interacts with three cooperators; a 
defector, as an outsider, can reach and 
exploit at most two. If the bonus for 
cheating is not too large, clusters of co- 
operators will grow 7 . Conversely, lone 
defectors will always do weH, because 
they will be surrounded by exploitable 
cooperators. But by spreading, defec¬ 
tors surround themselves with their 
like and so diminish their own returns. 

The actual evolution of such spatial 
systems depends on the payoff values. 
It is certainly possible that coo per a tors 
are wiped off the board. But we fre¬ 
quently find variously shifting mosaics, 
with both strategies being maintained. 
Mixtures of pure cooperators and pure 
defectors can coexist indefinitely, in 
fluctuating pro portions, but the long- 
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achieves a stable value after many generations of play {bottom left), in one snap¬ 
shot taken after 50 generations (fop left), each blue grid element contains a coop¬ 
erator that was a cooperator in the previous round; green shows a cooperator that 
was a defector; red represents a defector that was a defector; yellow indicates a 
defector that was a cooperator. When the initial conditions are symmetrical, the 
spatial game can develop a pattern resembling a Persian carpel (above). 


term average composition of the popu¬ 
lation is predictable. This conclusion is 
remarkably robust. In its essentials, it 
holds true for other choices of grid pat¬ 
terns and even for irregular or random 
arrays. The important requirement is 
that each player should not interact 
with too many neighbors. 

The straightforward rules of these 
spatial games define dynamics of daz¬ 
zling complexity. They allow for pat¬ 
terns that wander across the board, pe¬ 
riodically resuming their former shape. 
They can also display motifs that grow 
without limit. Some of these Features 
look like the results of John Horton 
Conway's game Life [see “Mathematical 
Games," by Martin Gardner; Scientific 
American, October 1970], a scheme to 
construct evolving spatial patterns us¬ 
ing simple rules to mimic regenerating 
organisms. It may well be that the re¬ 
sults generated by any one of our spa¬ 
tial versions of the Prisoner's Dilemma— 
be they irregular patterns or symmet¬ 
rical Persian carpets—are intrinsically 
unpredictable and chaotic in the sense 
lhai no algorithm can possibly predict 


whal will occur. Perhaps more dever 
mathematicians could devise a way to 
determine the future patterns. We arc 
satisfied to watch the arabesques un¬ 
fold [see “The Amateur Scientist,' 1 by 
Akin L. Lloyd, page 110]. 

That's Life 

T hroughout the evolutionary history 
of life, cooperation among smaller 
units led to the emergence of more 
complex structures, as, for example, the 
emergence of multicellular creatures 
from single-celled organisms. In this 


sense, cooperation becomes as essen¬ 
tial for evolution as is competition. 

Spatial structures in particular act to 
protect diversity. They allow coopera¬ 
tors and defectors to exist side by side. 
In a different but rdated context, similar 
spatial patterns allow populations of 
hosts and parasites, or prey and preda¬ 
tors, to survive together, despite the in¬ 
herent instability of Lheir interactions. 

Such cooperative strategies may have 
been crucial for prebiotic evolution, 
which many researchers believe may 
have taken place on surfaces rather 
than in well-stirred solutions. Catalyz¬ 
ing the replication of a molecule consti¬ 
tutes a form of mutual help; hence, a 
chain of catalysts, with each Unk feed¬ 
ing back on itself, would be the earliest 
instance of mutual aid [see “The Origin 
of Genetic Information, 1 ’ by Manfred Ei¬ 
gen, William Gardiner, Peter Schuster 
and Ruthild Winkler-Oswatitsch; Snr.N- 
TTFIC AMERICAN, April 1981 ]. 

Cooperative chemical reactions would 
have been vulnerable to “cheating" mo¬ 
lecular mutants that took more catalyt¬ 
ic aid than they gave. Such difficulties 
were thought to undercut many ideas 
about prebiotic evolution based on co¬ 
operative chains. But Maarten C. Boer- 
lijst and Pauline Hogeweg of Utrecht 
University have recently demonstrated 
with computer simulations that seif- 
generated spatial structures akin to 
those we devised can hamper the spread 
of destructive parasitic molecules. 

Our models, crude as they are, illus¬ 
trate how coopcralion might arise and 
be maintained in real biological systems. 
Sophisticated creatures may be drawn 
to follow^ strategies that encourage co¬ 
operation because of repeated interac¬ 
tions among individuals who can rec¬ 
ognize and remember one another. But 
In simpler organisms, cooperation per¬ 
sists, perhaps by virtue of self-orga¬ 
nized spatial structures generated by 
interactions with immediate neighbors 
in some fixed spatial array. In the course 
of evolution, there appears to have been 
ample opportunity for cooperation to 
have assisted everything from humans 
to molecules. In a sense, cooperation 
could be older than life itself. 
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Fermat’s 
Last Stand 


His most notorious theorem baffled the t 
greatest minds for more than three centuries, i 
But after 10 years of work, one 
mathematician cracked it 


by Simon Singh and Kenneth A. Ribet 


T his past June, 500 mathemati¬ 
cians gathered in the Great 
Hall of Gottingen University 
in Germany to watch Andrew j, Wiles 
of Princeton University collect the pres¬ 
tigious Wolfskehl Prize, The reward- 
established in 1908 for whoever proved 
Pierre de Fermat’s famed last theorem— 
was originally worth $2 million (in to¬ 
day’s dollars). By the summer of 1997, 
hyperinflation and the devaluation of the 
mark had reduced it to a mere $50,000, 
But no one cared. For Wiles, proving 
Fermat’s 17th-century conundrum had 
realized a childhood dream and ended 
a decade of intense effort. For the assem¬ 
bled guests, Wiles’s proof promised to 
revolutionize the future of mathematics. 
Indeed, to complete his 100-page cal¬ 
culation, Wiles needed ro draw on and 
further develop many modern ideas in 
mathematics. In particular, he had to 
tackle the Shim ur a-Taniyama conjec¬ 
ture, an important 20th-century insight 
into both algebraic geometry and com¬ 
plex analysis. In doing so. Wiles forged 
a link between these major branches of 
mathematics. Henceforth, insights from 
either field are certain to inspire new re¬ 
sults in the other. Moreover, now that 
this bridge has been huilt, other con¬ 
nections between distant mathematical 
realms may emerge. 

The Prince of Amateurs 

P ierre de Fermat was born on August 
20, 1601, in Beauniont-de-Lomagtie, 
a small town in southwest France, He 
pursued a career in local government 









and the judiciary. To ensure impartiali¬ 
ty, judges were discouraged from so¬ 
cializing, and so each evening Fermat 
would retreat to his study and concen¬ 
trate on his hobby, mathematics. Al¬ 
though an amateur, Fermat was highly 
accomplished and was largely responsi¬ 
ble for probability theory and the foun¬ 
dations of calculus. Isaac Newton, the 
father of modern calculus, stated that 
he had based his work tin “Monsieur 
Fermat’s method of drawing tangents.” 

Above all, Fermat was a master of 
number theory—the study of whole 
numbers and their relationships. He 
would often write to other mathemati¬ 
cians about his work on a particular 
problem and ask if they had the ingenu¬ 
ity to match his solution. These chal¬ 
lenges, and the fact that he would never 
reveal his own calculations, caused oth¬ 
ers a great deal of frustration. Retie Des¬ 
cartes, perhaps most noted for invent- 
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PIERRE DE FERMAT, a 17th-century master of num¬ 
ber theory often wrote to other mathematicians; 
asking if they had the ingenuity to match his solu¬ 
tions. He devised his most famous challenge his 
so-called last theorem, while studying Arithmetica, 
by Diophantus of Alexandria, Fermat asserted that 
there are no nontrivial solutions for the equation 
cri + £rT _ ( p t w here n represents any whole number 
greater than 2. In the margin of Arithmetica, Fer¬ 
mat jotted a comment that tormented three cen¬ 
turies of mathematicians: "I have a truly marvelous 
demonstration of this proposition, which this mar¬ 
gin is too narrow to contain/' 


ing coordinate geometry, called Fermat 
a braggart, and the English mathemati¬ 
cian John Wallis once referred ro him as 
“that damned Frenchman.” 

Fermat penned his most famous chal¬ 
lenge, his so-called last theorem, while 
studying die ancient Greek mathemati¬ 
cal text Arithmetica, by Diophantus of 
Alexandria. The book discussed positive 
whole-number solutions to the equation 
tr + b 2 = Pythagoras’s formula de- 
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ANDREW J. WILES of Princeton University proved 
Fermat's famed last theorem in 1994, after a 
decade of concentrated effort. To complete his 
100-page calculation, Wiles needed to draw on 
and further develop many modern ideas in math¬ 
ematics* In particular, he had to prove the Shimu- 
ra-Taniyama conjecture for a subset of elliptic 
curves, objects described by cubic equations 
such as y 1 - x 3 + ax 1 + hx + c . 


scribing the relation between the sides 
of a right triangle. This equation has 
infinitely many sets of integer solutions, 
such as a = 3, h = 4, c = 5, which are 
known as Pythagorean triples. Fermat 
took the formula one step further and 
concluded that there are no nontrivial 
solutions for a whole family of similar 
equations, a n + b n - c n , where n repre¬ 
sents any whole number greater than 2. 

It seems remarkable that although 
there are infinitely many Pythagorean 
tripies, there are no Fermat triples* Even 
so, Fermat believed he could support 
his claim with a rigorous proof. In the 
margin of Arithmetics, the mischievous 
genius jotted a comment that taunted 
generations of mathematicians: 64 1 have 
a truly marvelous demonstration of this 
proposition, which this margin is too 
narrow to contain.” Fermat made many 
such infuriating notes, and after his 
death his son published an edition of 
Arithmetics that included these teases. 
All the theorems were proved, one by 


one, until only Fermat’s last remained. 

Numerous mathematicians battled 
the last theorem and failed. In 1742 
Leonhard Euler, the greatest number 
theorist of the 18th century, became so 
frustrated by his inability to prove the 
last theorem that he asked a friend to 
search Fermat’s house in case some viral 
scrap of paper was left behind. In the 
19th century Sophie Germain—who, be¬ 
cause of prejudice against women math¬ 
ematicians, pursued her studies under 
the name of Monsieur Leblanc—made 
the first significant breakthrough. Ger¬ 
main proved a general theorem that 
went a long way toward solving Fer¬ 
mat’s equation for values of n that are 
prime numbers greater than 2 and for 
which In + 1 is also prime. (Recall that 
a prime number is divisible only by 1 
and itself.) But a complete proof for 
these exponents, or any others, re¬ 
mained out of her reach. 

At the start of the 20th century Paul 
Wolfskehl, a German industrialist, be¬ 
queathed 100,000 marks to whoever 
could meet Fermat’s challenge. Accord¬ 
ing to some historians, Wolfskehl was at 
one time almost at the point of suicide, 
but he became so obsessed with trying 
to prove the last theorem that his death 
wish disappeared. In light of what had 
happened, Wolfskehl rewrote his will* 


The prize was his way of repaying a debt 
to the puzzle that saved his life. 

Ironically, just as the Wolfskehl Prize 
was encouraging enthusiastic amateurs 
to attempt a proof, professional marhe- 
matidans were losing hope. When the 
great German logician David Hilbert 
was asked why he never attempted a 
proof of Fermat’s last theorem, he re¬ 
plied, “‘Before beginning I should have 
to put in three years of intensive study, 
and I haven’t that much time to squan¬ 
der on a probable failure.” The problem 
still held a special place in the hearts of 
number theorists, but they regarded Fer¬ 
mat’s last theorem in the same way that 
chemists regarded alchemy. It was a 
foolish romantic dream from a past age. 

The Childhood Dream 

C hildren, of course, love romantic 
dreams. And in 1963, at age TO, 
Wiles became enamored with Fermat’s 
last theorem. He read about it in his lo¬ 
cal library in Cambridge, England, and 
promised himself that he would find a 
proof. His schoolteachers discouraged 
him from wasting time on the impossi¬ 
ble. His college lecturers also tried to dis¬ 
suade him. Eventually his graduate su¬ 
pervisor at the University of Cam bridge 
steered him toward more mainstream 
mathematics, namely into the fruitful 
research area surrounding objects called 
elliptic curves. The ancient Greeks orig¬ 
inally studied elliptic curves, and they 
appear in Arithmetics. Little did Wiles 
know that this training would lead him 
back to Fermat’s last theorem. 

Elliptic curves are not ellipses. Instead 
dicy arc named as such because they are 
described by cubic equations, like those 
used for calculating the perimeter of an 
ellipse. In general, cubic equations fur 
elliptical curves rake the form y 2 = x 3 + 
ax^ 4- hx 4 - c, where a , b and c are 
w hole numbers that satisfy some simple 
conditions. Such equations are said to 
be of degree 3, because the highesr ex¬ 
ponent they contain is a cube. 

Number theorists regularly try to as¬ 
certain the number of so-called rational 
solutions, those that are whole numbers 
or fractions, for various equations. Lin¬ 
ear or quadratic equations, of degree 1 
and 2, respectively, have either no ratio¬ 
nal solutions or infinitely many, and it 
is simple to decide which is the case. 
For complicated equations, typically of 
degree 4 or higher, the number of solu¬ 
tions is always finite—a fact called Mor¬ 
ders conjecture, which the German 
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LEONHARD EULER, the greatest number theorist of the 18th century, be¬ 
came so frustrated by Fermat's last theorem that in 1742 he asked a friend 
to search Fermat's house for any scrap of paper left behind 



o* 

are a certain kind of function that deals 
with complex numbers of the form (% + 
iy), where x and y are real numbers, 
and i is the imaginary number (equal to 
the square root of-1), 

What makes modular forms special is 
that one can transform a complex num¬ 
ber in many ways, and yet the function 
yields virtually the same result. In this 
respect, modular forms are quite re¬ 
markable. Trigonometric functions are 
similar inasmuch as an angle, q, can be 
transformed by adding it, and yet the 
answer is constant: sin q = sin [q + Jt). 
This property is termed symmetry, and 
trigonometric functions display it to a 
limited extent. In contrast, modular 
forms exhibit an immense level of sym¬ 
metry. So much so that when the French 
polymath I lenri Poincare discovered 
the first modular forms in the late 19th 
century, he struggled to come to terms 
with their symmetry. 11c described to 
his colleagues how every day for two 
weeks he would wake up and search 
for an error in his calculations. On the 
15th day he finally gave up, accepting 
that modular forms are symmetrical in 
the extreme. 

A decade or so before Wiles learned 
about Fermat, two young Japanese 
mathematicians, Coro Shimura and Yu- 
taka Taniyama, developed an idea in¬ 
volving modular forms that would ulti¬ 
mately serve as a cornerstone in Wiles's 
proof. They believed that modular forms 
and elliptic curves were fundamentally 
related—even though elliptic curves ap- 


mathematician Gerd Fallings proved in 
1983. But elliptic curves present a unique 
challenge. They may have a finite or in¬ 
finite number of solutions, and there is 
no easy way of telling. 

To simplify problems concerning el¬ 
liptic curves, mathematicians often re¬ 
examine them using modular arithme¬ 
tic. They divide x and y in the cubic 
equation by a prime number/? and keep 
only die remainder. This modified ver¬ 
sion of the equation is its “mod p™ 
equivalent. Next, they repeat these divi¬ 
sions with another prime number, then 
another, and as they go, they note the 
number of solutions for each prime 
modulus. Eventually these calculations 
generate a series of simpler problems 
that are analogous to the original. 

The great advantage of modular 
arithmetic is that the maximum values 
of x and y are effectively limited to p, 
and so the problem is reduced to some¬ 
thing finite. To grasp some understand¬ 
ing of the original infinite problem, 
mathematicians observe how the num¬ 
ber of solutions changes as p varies. 
And using that information, they gener- 
ate a so-called L-scries for the elliptic 
curve. In essence, an L-serics is an infin¬ 
ite series in powers, where the value of 
the coefficient for each pth power is de¬ 
termined by the number of solutions in 
modulo 

In fact, other mathematical objects, 
called modular forms, also have L-se- 
ries. Modular forms should not he con¬ 
fused with modular arithmetic. They 


parently belonged to a totally different 
area of mathematics. In particular, be¬ 
cause modular forms have an L-series— 
although derived by a different prescrip¬ 
tion than that for elliptic curves—the 
two men proposed that every elliptic 
curve could be paired with a modular 
form, such that the two L-series would 
match. 

Shimura and Taniyama knew that if 
they were right, the consequences would 
be extraordinary. First, mathematicians 
generally know more about the L-series 
of a modular form than that of an ellip¬ 
tic curve. Hence, it would be unneces¬ 
sary to compile the l.-series for an ellip¬ 
tic curve, because it would be identical 
to that of the corresponding modular 
form. More generally, building such a 
bridge between two hitherto unrelated 
branches of mathematics could benefit 
both: potentially each discipline could 
become enriched by knowledge already 
gathered in the other. 

The Shimura-Taniyama conjecture, as 
it was formulated by Shimura in the 
early 1960s, states that every elliptic 
curve can be paired with a modular 
form; in other words, all elliptic curves 
are modular. Even though no one could 
find a way to prove it, as the decades 
passed the hypothesis became increas¬ 
ingly influential. By the 1970s, for in¬ 
stance, mathematicians would often as¬ 
sume that the Shimura-Taniyama con¬ 
jecture was true and then derive some 
new result from it. In due course, many 
major findings came to rely on the con¬ 
jecture, although few scholars expected 
it would be proved in this century. Trag¬ 
ically, one of the men who inspired it did 
not live to see its ultimate importance. 
On November 17, 1958, Yutaka Tani¬ 
yama committed suicide. 

The Missing Link 

T n the fall of 1984, at a symposium in 
A Oberwolfach, Germany, Gerhard Frey 
of the University of Saarland gave a lec¬ 
ture that hinted at a new strategy for at¬ 
tacking Fermat’s last theorem. The theo¬ 
rem asserts that Fermat’s equation has 
no positive whole-number solutions. To 
test a statement of this type, mathema¬ 
ticians frequently assume that it is false 
and then explore the consequences. To 
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GORO SH1MURA AND YUTAKA TANIYAMA (fop and bottom, respectively) devel¬ 
oped an idea during the 1950s that ultimately served in Wiles's proof Their con¬ 
jecture involved modular forms—functions that deal with complex numbers of 
the form (x + iy) f where x and y are real numbers, and / is the imaginary number 
(equal to the square root of-1). The two men proposed that every elliptic curve 
could be paired with a modular form, such that the L-series associated with each 
would match. Tragically, Taniyama did not live to see Wiles's success. On Novem¬ 
ber 17,1958, he killed himself 


say that Fermat’s last theorem is false is 
to say that there are two perfect nth 
powers whose sum is a third nth power. 

Frey’s idea proceeded as follows: Sup¬ 
pose that A and B are perfect nth pow¬ 
ers of two numbers such that A + B is 
again an nth power—that is, they are a 
solution to Fermat’s equation. A and B 
can then be used as coefficients in a spe¬ 
cial elliptic curve: y 2 = jc(* - A)(x + B). 
A quantity that is routinely calculated 
whenever one studies elliptic curves is 
the “discriminant” of the elliptic curve, 
A 2 B 2 (A + B) 2 . Because A and B are so¬ 
lutions to the Fermat equation, the dis¬ 
criminant is a perfect mh power. 

The crucial point in Frey’s tactic is that 
if Fermat’s last theorem is false, then 
whole-number solutions such as A and 
B can be used to construct an elliptic 
curve whose discriminant is a perfect wth 
power. So a proof that the discriminant 


of an elliptic curve can never be 
an «th power would contain, 
implicitly, a proof of Fermat’s 
last theorem. Frey saw no 
way to construct that 
proof. He did, how¬ 
ever, suspect that an 
elliptic curve whose 
discriminant was a 
perfect rath power—if 
it existed—could not be 
modular In other words, 
such an elliptic curve 
would defy the Shimura-Ta¬ 
rn yama conjecture. Running the 
argument backwards, Frey pointed 
out that if someone proved that the Shi- 
mura-Taniyama conjecture is true and 
that the elliptic equation y 2 = - A)(* 

+ B) is not modular, then they would 
have shown that the elliptic equation 
cannot exist. In that case, the solution 
to Fermat’s equation cannot exist, and 
Fermat’s last theorem is proved true. 

Many mathematicians explored this 
link between Fermat and Shimura-Tani¬ 
yama. Their first goal was to show that 
the Frey elliptic curve, y 2 = x[x - A)(x + 
B), was in fact not modular. Jean-Pierre 
Serre of the College of France and Bar¬ 
ry Mazur of Harvard University 
made important contributions in 
this direction. And in June 1986 
one of us (Ribet) at last con¬ 
structed a complete proof of 
the assertion. It is not possi¬ 
ble to describe the full ar¬ 
gument in this article, but 
we will give a few hints. 

To begin, Ribet’s proof 
depends on a geometric 
method for “adding” two 
points on an elliptic curve \see 
bottom illustration on next page]. 
Visually, the idea is that if you pro¬ 
ject a line through a pair of distinct 
solutions, Pt and ? 2 , the line cuts the 


SOPHIE GERMAIN pursued her studies under the name of Monsieur Leblanc because of prejudice 
against women mathematicians. She made the first significant breakthrough in the 19th century, 
proving a theorem that went a long way toward solving Fermat's equation for values of n that are 
prime numbers greater than 2 and for which 2n -f 1 is also prime. 


curve at a third point, which we might 
provisionally call the sum of P} and Pj* 
A slightly more complicated but more 
valuable version of this addition is as 
follows: first add two points and derive 
a new point, P?, as already described, 
and then reflect this point through the x 
axis to get the final sum, Q. 

This special form of addition can be 
applied to any pair of points within the 
infinite set of all points on an elliptic 
curve, but this operation is particularly 
interesting because there are finite sets 
of points having the crucial property 
that the sum of any two points in the 
set is again in the set. These finite sets of 
points form a group: a set of points that 
obeys a handful of simple axioms. It 
turns out that if the elliptic curve is 
modular, so are the points in each finite 
group of the elliptic curve. What Ribet 
proved is that a specific finite group of 
Frey’s curve cannot be modular, ruling 
out the modularity of the whole curve. 

For three and half centuries, the last 
theorem had been an isolated problem, 
a curious and impossible riddle on the 
edge of mathematics. In 1986 Ribet, 
building on Frey’s work, had brought it 
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KENNETH A, RIBET followed Frey's lead and in June 1986 proved that 
any elliptic curve could not be modular if its discriminant were a per¬ 
fect nth power Ribet's proof depends on a geometric method for 
''adding 1 ' points on an elliptic curve Visually the idea is that it is possi¬ 
ble to project a line through a pair of points on the elliptic curve, P } 
and P 2 , to obtain a third point, P 3 .This new point is then reflected in 
thexaxis to obtain Q, which is said to be the sum of P } and P 2 , Whereas 
the set of all points on an elliptic curve is infinite, there are finite sets of 
points having the crucial property that the sum of any two points in the 
set is again in the set. Such finite sets obey 
certain special axioms and thus form 
so-called finite groups. If an ellip¬ 
tic curve is modular, so are the 
points in each finite group. 

Ribet proved that a specif¬ 
ic finite group of Frey's 
curve cannot be modular, 
ruling out the modu- 
larity of the whole curve. 
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GERHARD FREY suggested a new strategy for attacking Fermat's last theorem in 1984: Suppose 
that A and B are perfect nth powers such that A + B is again an mh power—that is, they are a solu¬ 
tion to Fermat's equation. A and Bean then be used as coefficients in a special elliptic curve; y 2 =x(x 
- A}(x + 8); the "discriminant" of this elliptic curve, A 2 B 2 [A + B) 2 is also a perfect nth power. Frey 
suspected that such an elliptic curve could not be modularJn other words, Frey pointed out that if 
someone proved that the Shimura-Taniyama conjecture is true or that all elliptic curves are mod¬ 
ular, then they might be able to show that the elliptic equationy 2 =x(x - A)(x + 8) cannot exist—in 
which case, the solution to Fermat's equation cannot exist, and Fermat's last theorem is proved true. 


center stage. It was possible to prove 
Fermat's last theorem by proving the 
Shimura-Taniyama conjecture. Wiles, 
who was by now a professor at Prince¬ 
ton, wasted no time. For seven years, he 
worked in complete secrecy. Not only 
did he want to avoid the pressure of 
public attention, but he hoped to keep 
others from copying his ideas. During 
this period, only his wife learned of his 
obsession—on their honeymoon. 

Seven Years of Secrecy 

W iles had to pull together many of 
the major findings of 20th-centu¬ 
ry number theory. When those ideas 
were inadequate, he was forced to cre¬ 
ate other tools and techniques. He de¬ 
scribes his experience of doing mathe¬ 


matics as a journey through a dark, un¬ 
explored mansion: “You enter the first 
room of the mansion, and it's complete- 
| ly dark. You stumble around humping 
I into the furniture, but gradually you 
| learn where each piece of furniture is, 
@ Finally, after six months or so, you find 
| the light switch. You turn k on, and 
5 suddenly it’s all illuminated. You can 
£ see exactly where you were. Then you 
I move into the next room and spend an¬ 
other six months in the dark. So each of 
these breakthroughs, while sometimes 
they're momentary, sometimes over a 
period of a day or two, they are the cul¬ 
mination of, and couldn’t exist with¬ 
out, the many months of stumbling 
around in the dark that precede them,” 
As it turned out, Wiles did not have to 
prove the full Shimura-Taniyama con¬ 
jecture. Instead he had to show only that 
a particular subset of elliptic curves— 
one that would include the hypothetical 
elliptic curve Frey proposed, should it 
exist—is modular. It wasn’t really much 
of a simplification. This subset is still 
infinite in size and includes the majority 
of interesting cases, Wiles’s strategy used 
the same techniques employed by Ribet, 


plus many more. And as with Ri bet’s 
argument, it is possible to give only a 
hint of the main points involved. 

The difficulty was to show that every 
elliptic curve in Wiles's subset is modu- 
iar. To do so. Wiles exploited the group 
property of points on the elliptic curves 
and applied a theorem of Robert P. 
Langlands of the Institute for Advanced 
Study in Princeton, N.J., and Jerrold 
Tunnel 1 of Rutgers University, The the- 
orem shows, for each elliptic curve in 
Wiles’s set, that a specific group of points 
inside the elliptic curve is modular. This 
requirement is necessary hut not suffi¬ 
cient to demonstrate that the elliptic 
curve as a whole is modular. 

The group in question has only nine 
elements, so one might imagine that its 
modularity represents an extremely 
small first step toward complete modu¬ 
larity. To close this gap. Wiles wanted 
to examine increasingly larger groups, 
stepping from groups of size 9 to 9 2 , or 
81, then to 9 3 , or 729, and so on. If he 
could reach an infinitely large group 
and prove that it, too, is modular, that 
would be equivalent to proving that the 
entire curve is modular. 













Wiles accomplished this task via a 
process loosely based on induction. He 
had to show that if one group was mod¬ 
ular, then so must be the next larger 
group* This approach is similar to top¬ 
pling dominoes: to knock down an in¬ 
finite number of dominoes, one merely 
has to ensure that knocking down any 
one domino will always topple the next* 
Eventually Wiles felt confident that his 
proof was complete, and on June 23, 
1993, he announced his result at a con¬ 
ference at the Isaac Newton Mathemat¬ 
ical Sciences Institute in Cambridge* 
His secret research program had been a 
success, and the mathematical commu¬ 
nity and the world’s press were sur¬ 
prised and delighted by his proof* The 
front page of the New York Times ex¬ 
claimed, “At Last, Shout of 'Eureka!’ in 
Age-Old Math Mystery” 

As the media circus intensified, the 
official peer-review process began* Al¬ 
most immediately, Nicholas M* Katz of 
Princeton uncovered a fundamental and 
devastating flaw in one stage of Wiles’s 
argument* In his induction process, 
Wiles had borrowed a method from 
Victor A* Kolyvagin of Johns Hopkins 
University and Matthias Flach of the 
California Institute of Technology to 
show that the group is modular* But it 
now seemed that this method could not 
be relied on in this particular instance* 
Wiles’s childhood dream had turned 
into a nightmare* 

Finding the Fix 

F or the next 14 months. Wiles hid 
himself away, discussing the error 
only with his former student Richard 
Taylor. Together they wrestled with the 
problem, trying to patch up the method 
Wiles had already used and applying 
other tools that he had previously reject¬ 
ed. They were at the point of admitting 



"EUREKA!" read a New York Times headline after Wiles revealed his first proof of Fermat's 
last theorem at a lecture in June 1993* Soon thereafter, though, reviewers found a serious 
flaw. Wiles discussed the error only with his former student Richard Jay I or* Together they 
tried to patch up the method Wiles had used and applied tools that he had previously re¬ 
jected. At last, on September 19,1994, they found the vital fix. 


defeat and releasing the flawed proof so 
that others could try to correct it, when, 
on September 19,1994, they found the 
vital fix* Many years earlier Wiles had 
considered using an alternative approach 
based on so-called Iwasawa theory, hut 
it floundered, and he abandoned it* 
Now he realized that what was causing 
the Kolyvagin-Flach method to fail was 
exactly what would make the Iwasawa 
theory approach succeed. 

Wiles recalls his reaction to the dis¬ 
covery: “It was so indescribably beauti¬ 
ful; it was so simple and so elegant. The 
first night I went back home and slept 
on it* 1 checked through it again the 
next morning, and I went down and told 
my wife, Tve got it. I think Pve found 
it*’ And it was so unexpected that she 
thought I was talking about a children’s 
toy or something, and she said, "Got 


what?’ I said, Tve fixed my proof* I’ve 
got it*’” 

For Wiles, the award of the Wolfskehl 
Prize marks the end of an obsession that 
lasted more than 30 years: “Having 
solved this problem, there’s certainly a 
sense of freedom. I was so obsessed by 
this problem that for eight years I was 
thinking about it all of the time—when 
I woke up in the morning to when I 
went to sleep at night. That particular 
odyssey is now over. My mind is at rest.” 
For other mathematicians, though, ma¬ 
jor questions remain. In particular, all 
agree that Wiles’s proof is far too com¬ 
plicated and modern to be the one that 
Fermat had in mind when he wrote his 
marginal note. Either Fermat was mis¬ 
taken, and his proof, if it existed, was 
flawed, or a simple and cunning proof 
awaits discovery. 
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The Challenge of Large Numbers 


As computer capabilities increase, mathematicians 
can better characterize and manipulate gargantuan figures. 


Even so, some numbers can only be imagined 



by Richard E. Crandall 
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L arge numbers have a distinct ap¬ 
peal, a majesty if you will. In a 
/ sense, they lie at the limits of 
the human imagination, which is why 
they have long proved elusive, difficult 
to define and harder still to manipulate. 
In recent decades, though, computer ca¬ 
pabilities have dramatically improved. 
Modern machines now possess enough 
memory and speed to handle quire im¬ 
pressive figures. For instance, it is possi¬ 
ble to mill tip ly together mil lion-digit 
numbers in a mere fraction of a second. 
As a result, we can now characterize 
numbers about which earlier mathe¬ 
maticians could only dream. 

Interest in large numbers dates back 
to ancient rimes. We know, for exam¬ 
ple, that the early Hindus, who devel¬ 
oped the decimal system, contemplated 
them. In the now commonplace decimal 
system the position of a digit ( is, IDs, 
100s and so on) denotes its scale. Using 
this shorthand, the Hindus named many 
large numbers; one having 153 digits— 
or as we might say today, a number of 
order IQ 153 —is mentioned in a myth 
about Buddha. 

The ancient Egyptians, Romans and 



Greeks pondered large values as well. 
But historically, a large number was 
whatever the prevailing culture deemed 
it to be—an intrinsically circular defini¬ 
tion. The Romans initially had no terms 
or symbols for figures above 100,000. 
And the Greeks usually stopped counting 
at a myriad, a word meaning w 10,000.” 
Indeed, a popular idea in ancient Greece 
was that no number was greater than 
the total count of sand grains needed to 
fib the universe. 

In the third century B.C, Greek math¬ 
ematician Archimedes sought to correct 
this belief. In a letter to King Gelon of 
Syracuse, he set out to calculate the ac¬ 
tual number of sand grains in the uni¬ 
verse. To do so, Archimedes devised a 
clever scheme involving successive ra¬ 
tios that would effectively extend the 
prevailing Greek number system, which 
had no exponential scaling. I Iis results, 
which in current terms placed the num¬ 
ber somewhere between 10 51 to 10 63 , 
were visionary; in fact, a sphere having 
the radius of Pluto’s orbit would con¬ 
tain on the order of lO^ 1 grains. 

Scholars in the 18th and 19rh centur¬ 
ies contemplated large numbers that still 
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have practical scientific relevance. Con¬ 
sider Avogadro’s number, named after 
the 19th-century Italian chemist Ame* 
deo Avogadro, It is roughly 6.02 x 10 23 
and represents the number of atoms in 
12 grams of pure carbon. One way to 
think about Avogadro’s number, also 
called a mole, is as follows: if just one 
gram of carbon were expanded to the 
size of planet Earth, a single carbon 
atom would loom something like a 
bowling ball. 

Another interesting way to imagine a 
mole is to consider the total number of 
computer operations—that is, the arith- 
metic operations occurring within a 
computer’s circuits—ever performed by 
all computers in history. Even a small 
machine can execute millions of opera¬ 
tions per second; mainframes can do 
many more. Thus, the total operation 
count to date, though impossible to es¬ 
timate precisely, must be close to a mole. 
It will undoubtedly have exceeded that 
by the year 2000, 

Today scientists deal with numbers 
much larger than the mole. The num¬ 
ber of protons in the known universe, 
for example, is thought to be about 


LARGE NUMBERS—such as the 100-dig- 
it, or googol-size, ones running across the 
tops of these pages—have become more 
accessible over time thanks to advances in 
computing. Archimedes, whose bust ap¬ 
pears at the left, had to invent new math¬ 
ematics to estimate the number of sand 
grains required to fill the universe. His as¬ 
tonishingly accurate result, 10 51 , was by 
ancient standards truly immense. Modern 
machines, however, routinely handle vast¬ 
ly greater values. Indeed, any personal 
computer with the right software can 
completely factor a number of order 10 vl , 


10 8n . But the human imagination can 
press further. It is legendary diat the 
nine-year-old nephew of mathematician 
Edward Kasner did coin, in 1938, the 
googol, as 1 followed by 100 zeroes, or 
10>00 ^tii respect to some classes of 
computational problems, the googol 
roughly demarcates the number magni¬ 
tudes that begin seriously to challenge 
modern machinery. Even so, machines 
can even answer some questions about 
gargantua as large as the mighty goo¬ 
gol pi ex, which is 1 followed by a goo¬ 
gol of zeroes, or 10 lolU0 . Even if you 
used a proton for every zero, you could 
not scribe the googolplex onto the 
known universe. 

Manipulating the Merely Large 

S omewhat above the googol lie num¬ 
bers that present a sharp challenge 
to practitioners of the art of factoring: 
the art of breaking numbers into their 
prime factors, where primes are them¬ 
selves divisible only by 1 and themselves. 
For example, 1,799,257 factors into 
7,001 X 257, but to decompose a suffi¬ 
ciently large number into its prime fac¬ 
tors can be so problematic that comput¬ 
er scientists have harnessed this difficulty 
to encrypt data. Indeed, one prevailing 
encryption algorithm, called RSA, trans¬ 
forms the problem of cracking encrypt¬ 
ed messages into that of factoring cer¬ 
tain large numbers, called public keys. 
(RSA is named after its inventors, Ron¬ 
ald L. Rivest of the Massachusetts Insti¬ 
tute of Technology, Adi Shamir of the 
Weizmann Institute of Science in Israel 
and Leonard M. Adleman of the Uni¬ 
versity of Southern California. ) 

To demonstrate the strength of RSA, 
Rivest, Shamir and Adleman challenged 


readers of Martin Gardner’s column in 
the August 1977 Issue of Scientific 
American to factor a 129-digit number, 
dubbed RSA-129, and find a hidden 
message. It was not until 1994 that Ar- 
jen K. Lenstra of Bellcore, Paul Ley land 
of the University of Oxford and then 
graduate student Derek Atkins of M.I.T. 
and undergraduate student Michael 
Graff of Iowa State University, working 
with hundreds of colleagues on the In¬ 
ternet, succeeded. (The secret encrypted 
message was M THE MAGIC WORDS ARE 
SQUEAMISH GSS1FRAGE. ”) Current rec¬ 
ommendations suggest that RSA en¬ 
cryption keys have at least 230 digits to 
be secure. 

Network collaborations are now com¬ 
monplace, and a solid factoring culture 
has sprung up. Samuel S. Wagstaff, Jr., 
of Purdue University maintains a fac¬ 
toring newsletter listing recent factor¬ 
izations. And along similar lines, Chris 
K. Caldwell of the University of Ten¬ 
nessee at Martin maintains a World 
Wide Web site (http://www.utm.edu/ 
resea rch/primes/la rgest. h tmi) for prim e 
number records. Those who practice 
factoring typically turn to three power¬ 
ful algorithms. The Quadratic Sieve (QS) 
method, pioneered by Carl Pome ranee 
of the University of Georgia in the 1980s, 
remains a strong, general-purpose at¬ 
tack for factoring numbers somewhat 
larger than a googol. (The QS, in fact, 
conquered RSA-129.) To factor a mys¬ 
tery number, the QS attempts to factor 
many smaller, related numbers generat¬ 
ed via a clever sieving process. These 
smaller factorizations are combined to 
yield a factor of the mystery number, 

A newer strategy, the Number Field 
Sieve (NFS), toppled a 155-digit number, 
the ninth Fermat number, P 9 . (Named 
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for the great French theorist Pierre de 
Fermat, the nth Fermat number is F n ~ 
2 2 ” + I.) In 1990 F$ fell to Arjen Len¬ 
stra, Hendrik W. Lenstra, Jr., of the Uni¬ 
versity of California at Berkeley, Mark 
Manasse of Digital Equipment Corpo¬ 
ration and British mathematician John 
Pollard, again aided by a substantial 
machine network* This spectacular fac¬ 
torization depended on F^’s special 
form. But Joseph Buhler of Reed Col¬ 
lege, Hendrik Lenstra and Pomerance 
have since developed a variation of the 
NFS for factoring arbitrary numbers. 
This general NFS can, today, comfort¬ 
ably factor numbers of 130 digits* In ret¬ 
rospect, RSA-129 could have been fac¬ 
tored in less time this way. 

The third common factoring tactic, 
the Elliptic Curve Method (ECM), de¬ 
veloped by Hendrik Lenstra, can take 
apart much larger numbers, provided 
that at least one of the number's prime 
factors is sufficiently small. For exam¬ 
ple, Richard R Brent of the Australian 
National University recently factored 
F 10 using ECM, after first finding a sin¬ 
gle prime factor “only" 40 digits long. 
It is difficult to find factors having more 
than 40 digits using ECM. For arbi¬ 
trary numbers between, say, 10 150 and 


i0L° 00 » 000 , ECM stands as the method 
of choice, although ECM cannot be ex¬ 
pected to find all factors of such gar¬ 
gantuan numbers. 

Even for numbers that truly dwarf the 
googol, isolated factors can sometimes 
he found using a centuries-old sieving 
method. The idea is to use what is called 
modular arithmetic, which keeps the 
sizes of numbers under control so that 
machine memory is not exceeded, and 
adroitly scan (“sieve”) over trial factors. 
A decade ago Wilfrid Keller of the Uni¬ 
versity of Hamburg used a sieving tech¬ 
nique to find a factor for the awesome 
E 23471 , which has roughly lO 7,000 deci¬ 
mal digits, Keller's factor itself has “only" 
about 7,000 digits. And Robert J, l iar- 
ley, then at the California Institute of 
Technology, turned to sieving to find a 
36-digit factor for the stultifying (goo- 
goiplex +1); the factor is 316,912,650, 
057,057,350,374,175,801,344,000,001. 

Algorithmic Advancements 

M any modem results on large num¬ 
bers have depended on algorithms 
from seemingly unrelated fields. One 
example that could fairly be called the 
workhorse of all engineering algorithms 


is the Fast Fourier Transform (EFT). 
The FFT is most often thought of as a 
means for ascertaining some spectrum, 
as is done in analyzing birdsongs or hu¬ 
man voices or in properly tuning an 
acoustic auditorium. It turns out that 
ordinary multiplication—a fundamen¬ 
tal operation between numbers—can he 
dramatically enhanced via FFT [see box 
below\, Arnold Sehonage of the Univer¬ 
sity of Bonn and others refined this as¬ 
tute observation into a rigorous theory 
during the 1970s, 

FFT multiplication has been used in 
celebrated calculations of n to a great 
many digits. Granted K is not a bona 
fide large number, but to compute K to 
millions of digits involves the same kind 
of arithmetic used in large-number stud¬ 
ies. In 1985 R. William Gosper, Jr., of 
Symbolics, Inc., in Palo Alto, Caltf., com¬ 
puted 17 million digits of n. A year lat¬ 
er David Bailey of the National Aero¬ 
nautics and Space Administration Ames 
Research Center computed n to more 
than 29 million digits. More recently, 
Bailey and Gregory Chudnovsky of Col¬ 
umbia University reached one billion 
digits. And Yasumasa Kanada of the 
University of Tokyo has reported five 
billion digits. In case anyone wants to 


Using Fast Fourier Transforms for Speedy Multiplication 


O rdinary multiplication is a long-winded process by any ac¬ 
count, even for relatively small numbers: To multiply two 
numbers, x and y f each having D digits, the usual, "grammar 
school" method involves multiplying each successive digit of x 
by every digit of y and then adding columnwise, for a total of 
roughly D 2 operations. During the 1970s, mathematicians devel¬ 
oped means for hastening multiplication of two D-digit numbers 
by way of the Fast Fourier Transform (FFT). The FFT reduces the 
number of operations down to the order of D log D. {For exam¬ 
ple, for two 1,000-digit numbers, the grammar school method 
may take more than 1,000,000 operations, whereas an FFT might 
take only 50,000 operations.) 

A full discussion of the FFT algorithm for multiplication is be¬ 
yond the scope of this article, in brief, the digits of two numbers, 
x and y (actually, the digits in some number base most conve¬ 
nient for the computing machinery) are thought of as signals. 
The FFT is applied to each signal in order to decompose the sig¬ 
nal into its spectral components. This is done in the same way 
that a biologist might decompose a whale song or some other 
meaningful signal into frequency bands. These spectra are 
quickly multiplied together, frequency by frequency.Then an in¬ 
verse FFT and some final manipulations are performed to yield 
the digits of the product of xandy. 

There are various, powerful modern enhancements to this ba¬ 
sic FFT multiplication. One such enhancement is to treat the dig¬ 


it signals as bipolar, meaning both positive and negative digits 
are allowed. Another is to "weight" the signals by first multiply¬ 
ing each one by some other special signal. These enhancements 
have enabled mathematicians to discover new prime numbers 
and prove that certain numbers are prime or composite {not 
prime), —R£C 


x = 18986723467242 .,.. 


"balanced signal" of x 

/wWW 


y = 1001345787777.,.. 


"balanced signal" of y 


Compute FFT spectra of x and y 
signals and multiply spectra together 


Take inverse spectrum and 
un ba la nee, to obta i n x ti m es y >■ 





product spectrum 


x * y — 19012260610305440490 
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check this at home, the one-billionth dec¬ 
imal place of jc, Kanada says, is nine. 

FFT has also been used to find large 
prime numbers. Over the past decade or 
so, David Slowinski of Cray Research 
has made a veritable art of discovering 
record primes. Slowinski and his co¬ 
worker Paul Gage uncovered the prime 
21,257,78 7_ i A few months 

later, in November, programmers Joel 
Armengaud of Paris and George F. 
Whitman of Orlando, Fla., working as 
part of a network project run by Wok- 
man, found an even larger 
prime: 2 U9S > M9 -1. This 
number, which has over 
400,000 decimal digits, is 
the largest known prime 
number as of this writing. 

It is, like most other record 
holders, a so-called Mer¬ 
senne prime. These num¬ 
bers take the form 2 q -1 , 
where q is an integer, and 
are named after the 17th- 
century French mathemati¬ 
cian Marin Mersenne. 

For this latest discovery, 

Woimian optimized an al¬ 
gorithm called an irra¬ 
tional-base discrete weight¬ 
ed transform, the theory of 
which 1 developed in 1991 
with Barry Fagin of Dart¬ 
mouth College and Joshua 
Doenias of NeXT Software 
in Redwood City, Calif. | 

This method was actually a | 
by-p rod net of eryptogra p hy 5 
research at NeXT 

Blaine Garst, Doug 
Mitchell, Avadis Tevanian, 

Je, and I implemented at 
NeXT what is one of the 
strongest—if not the strong¬ 
est—encrypt ion schemes available today, 
based on Mersenne primes. This patent¬ 
ed scheme, termed Fast Elliptic Encryp¬ 
tion (FEE), uses the algebra of elliptic 
curves, and it is very fast. Using, for ex¬ 
ample, the newfound Armengaud-Wolt- 
man prime 2h 39S ^ 69 —1 as a basis, the 
FEE system could readily encrypt this 
issue of Scientific American into seem¬ 
ing gibberish. Under current number- 
theoretical beliefs about the difficulty of 
cracking FEE codes, it would require, 
without knowing the secret key, all the 
computing power on earth more than 
IQttXooo y ears to decrypt the gibberish 
back into a meaningful magazine. 


Just as with factoring problems, prov¬ 
ing diat a large number is prime is much 
more complicated if the number is arbi¬ 
trary—that is, if it is not of some special 
form, as are the Mersenne prunes. For 
primes of certain special forms, “Large” 
falls somewhere in the range of 2k 0£X,,000 _ 
But currently it takes considerable com¬ 
putational effort to prove that a “ran¬ 
dom” prime having only a few thousand 
digits is indeed prime. For example, in 
1992 it took several weeks for Francois 
Morian of the University of Claude Ber¬ 


nard, using techniques developed joint¬ 
ly with A.O.L. Atkin of the University 
of Illinois, and others, to prove by com¬ 
puter that a particular 1,505-digit num¬ 
ber, termed a partition number, is prime. 

Colossal Composites 

I t is quite a bit easier to prove that some 
number is not prime (that it is com¬ 
posite, that is, made up of more than 
one prime factor). In 1992 Doenias, 
Christopher Norrie of Amdahl Corpo¬ 
ration and I succeeded in proving by 
machine that the 22nd Fermat number, 
H 22 + 1 , is composite. This number has 


more than one million decimal digits. 
Almost all the work to resolve the char¬ 
acter of F 2 2 depended on yet another 
modification of EFT multiplication. This 
proof has been called the longest calcu¬ 
lation ever performed for a “one-bit,” 
or yes-no, answer, and it took about 
10 16 computer operations. That is 
roughly the same amount that went into 
generating the revolutionary Pixar-Dis¬ 
ney movie Toy Story, with its gloriously 
rendered surfaces and animations. 

Although it is natural to suspect the 


validity of a ny machine proof, there is a 
happy circumstance connected with this 
one. An independent team of Vi I mar 
Trevisan and Joao B. Carvalho, work¬ 
ing at the Brazilian Supercomputer Cen¬ 
ter with different machinery and soft¬ 
ware (they used, in fact, Bailey’s FFT 
software) and unaware of our complet¬ 
ed proof, also concluded that F 22 ^ COm ' 
posite. Thus, it seems fair to say, without 
doubt, that f 12 is composite. Moreover, 
F 22 siso now the largest “genuine” 
composite known—which means that 
even though we do not know a single 
explicit factor for P '22 °ther than itself 
and 1, we do know that it is not prime. 



COLOSSI become somewhat easier to contemplate—and compare—if one adopts a statistical view. 
For instance, it would take approximately 10^™,000 years before a parrot, peeking randomly at a 
keyboard, could reproduce by chance The Hound of the Baskennlles. This time span, though enor¬ 
mous, pales in comparison to the 10 10 ^ years that would elapse before fundamental quantum fluc¬ 
tuations might topple a beer can on a level surface. 
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How Large Is Large? 


To get a better sense of how enormous some numbers truly are, Imagine 
that the 10-digit number representing the age In years of the visible 
universe were a single word on a page. 

Then, the number of protons in the visible universe, about 10 so , would 
look like a sentence. The ninth Fermat number—which has the value 
F n - (where n is nine}—would take up several lines. 



The 10th Fermat number would look something like a paragraph 
of digits. 


A 1,000-digit number, pressing the upper limit for random 
primality testing, would look like a page of digits. 


The largest known prime number^ 1 *398,269 -i ( in decimal 
form, would essentially fill an issue of Scientific American* 


A book could hold all the digits of the 22nd Fermat 
number, which possesses more than one million 
digits and is now known to be composite. 


To multiply together two"bookshelves,” even on a scalar 
supercomputer, takes about one minute. 


10 10 , written in decimal form, would fill a library much 
larger than the earth's volume. In fact, there are theoretically 
important numbers that cannot be written down in this 
universe, even using exponential notation. 


'1 


Just as with Archimedes' sand grains 
in his time, there will always be colossal 
numbers that transcend the prevailing 
tools. Nevertheless, these numbers can 
still be imagined and studied. In partic¬ 
ular, it is often helpful to envision statis¬ 
tical or biological scenarios. For in¬ 
stance, the number 10 to the three-mil¬ 
lionth power begins to make some 
intuitive sense if we ask how long it 
would take a laboratory parrot, peck¬ 
ing randomly and tirelessly at a key¬ 
board, with a talon occasionally pump¬ 
ing the shift key, say, to render by acci¬ 


dent that great detective epic, by Sir Ar¬ 
thur Conan Doyle, The Hound of the 
Baskeruilles. To witness a perfectly 
spelled manuscript, one would expect 
to watch the bird work for approxi¬ 
mately 10 ^ 000,000 years. The probable 
age of the universe is more like a paltry 
10 10 years. 

But IQimm nothing compared 
with the time needed in other scenarios. 
Imagine a full beer can, sitting on a level, 
steady, rough-surfaced table, suddenly 
toppling over on its side, an event made 
possible by fundamental quantum fluc¬ 


tuations. Indeed, a physicist might grant 
that the quantum wave function of the 
can does extend, ever so slightly, away 
from die can so that toppling is not im¬ 
possible. Calculations show that one 
would expect to wait about 10 1033 years 
for the surprise event. Unlikely as the 
can toppling might be, one can imagine 
more staggering odds. What is the prob¬ 
ability, for example, that sometime in 
your life you will suddenly find yourself 
standing on planet Mars, reassembled 
and at least momentarily alive? Making 
sweeping assumptions about the reas¬ 
sembly of living matter, 1 estimate the 
odds against this bizarre event to be 
10 1051 to 1. To write these odds in deci¬ 
mal form, you would need a 1 followed 
by a zero for every one of Archimedes’ 
sand grains. To illustrate how unlikely 
Mars teleportation is, consider that the 
great University of Cambridge mathe¬ 
matician John Littlcwood once estimat¬ 
ed the odds against a mouse living on 
the surface of the sun for a week to be 
10>° 42 tol. 

These doubly exponentiated numbers 
pale in comparison to, say, Skewes's 
number, 10iG lt>34 , which has actually 
been used in developing a theory about 
the distribution of prime numbers. To 
show the existence of certain difficult- 
to-compute functions, mathematicians 
have invoked the Ackermann numbers 
(named after Wilhelm Ackermann of 
the Gymnasien in Luedenscheid, Ger¬ 
many), which compose a rapidly grow¬ 
ing sequence that runs: 0, 1, 2 2 y 3 3 33 _ 

The fourth Ackermann number, involv¬ 
ing exponentiated 3 5 s, is approximately 
1 q3,63833 4 t 6 4 0,02 4 'pft e fifth one is so 

large that it could not be written on a 
universe-size sheet of paper, even using 
exponential notation! Compared with 
the fifth Ackermann number, the mighty 
googolplex is but a spit in the prover¬ 
bial bucket. ■ 
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Confronting Science’s 
Logical Limits 

The mathematical models now used in many scientific fields 
may be fundamentally unable to answer certain questions about 
the real world. Yet there may be ways around these problems 


by John L. Casti 
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T o anyone infected with the 
idea that die human mind is 
unlimited in its capacity to an¬ 
swer questions, a tour of 20th-century 
mathematics must be rather disturbing. 
In 1931 Kurt Godel set forth his incom¬ 
pleteness theorem, which established 
that no system of deductive inference 
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can answer all questions about numbers. 
A few years later Alan M. Turing proved 
an equivalent assertion about computer 
programs, which states that there is no 
systematic way to determine whether a 
given program will ever halt when pro¬ 
cessing a set of data. More recently, 
Gregory J. Chaitin of IBM has found 
arithmetic propositions whose truth can 
never be established by following any 
deductive rules. 

These findings proscribe our ability to 
know in the world of mathematics and 
logic. Are there similar limits to our abil¬ 
ity to answer questions about natural 
and human affairs? The first and per- 
haps most vexing task in confronting 
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this issue is to settle what we mean by 
“scientific knowledge.” To cut through 
this philosophical Gordian knot, let me 
adopt the perhaps moderately contro- 
versial position that a scientific way of 
answering a question takes the form of 
a set of rules, or program. We simply 
feed the question into the rules as input, 
turn the crank of logical deduction and 
wait for the answer to appear. 

Thinking of scientific knowledge as 
being generated by what amounts to a 
computer program raises the issue of 
computational intractability. The diffi¬ 
culty of solving the celebrared travel¬ 
ing-salesman problem, which involves 
finding the shortest route connecting a 
large number of cities, is widely believed 
to increase exponentially as the number 
of destinations rises. For example, pin¬ 
pointing the best itinerary' for a sales¬ 
man visiting 100 cities would require 
examining 100 x 99 x 98 x 97 x.,. x 1 
possibilities—a task that would take 
even the fastest computer billions of 
years to complete. 

But such a computation is possible—at 
least in principle. Our focus is on ques¬ 
tions for which there exists no program 
at all that can produce an answer What 
would be needed for the world of phys¬ 
ical phenomena to display the kind of 
logical unanswerability seen in mathe¬ 
matics? 1 contend that nature would 
have to be either inconsistent or incom¬ 
plete, in the following senses. Consis¬ 
tency means that there are no true para- 

TRAVEL1NG SALESMAN would need 
the world’s fastest computer running for 
billions of years to calculate the shortest 
route between 100 destinations. Scientists 
arc now seeking ways to make such daunt¬ 
ing problems more tractable. 
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doxes in nature, In general, when we 
encounter what appears to be such a 
paradox—such as jets of gas that seemed 
to he ejected from quasars at faster than 
light speeds—subsequent investigation 
has provided a resolution, (The “super- 
luminal” jets turned out to be an opti¬ 
cal illusion stemming from relativistic 
effects,) 

Completeness of nature implies that a 
physical state cannot arise for no rea¬ 
son whatsoever; in short, there is a cause 
for every effect. Some analysts might 
object that quantum theory contradicts 
the claim chat nature is consistent and 
complete. Actually, the equation gov¬ 
erning the wave function of a quantum 
phenomenon provides a causal expla¬ 
nation for every observation (complete¬ 
ness) and is well defined at each instant 
in time (consistency). The notorious 
“paradoxes” of quantum mechanics 
arise because we insist on thinking of 
the quantum object as a classical one, 

A Triad of Riddles 

I t is my belief that nature is both con¬ 
sistent and complete. On the other 
hand, science’s dependence on mathe¬ 
matics and deduction hampers our abil¬ 
ity to answer certain questions about 
the natural world. To bring this issue 
into sharper focus, let us look at three 
well-known problems from the areas of 
physics, biology and economics. 

• Stability of the solar system. The 
most famous question of classical me¬ 
chanics is the IV-body problem. Broadly 
speaking, this problem looks at the be¬ 
havior of a number, N, of point-size 


masses moving in accordance with New¬ 
ton’s law of gravitational attraction. 
One version of the problem addresses 
whether two or more of these bodies 
will collide or whether one will acquire 
an arbitrarily high velocity in a finite 
time. In his 1988 doctoral dissertation, 
Zhihong (Jeff) Xia of Northwestern 
University showed how a single body 
moving back and forth between two bi¬ 
nary systems (for a total of five masses} 
could approach an arbitrarily high ve¬ 
locity and be expelled from the system. 
This result, which was based on a special 
geometric configuration of the bodies, 
says nothing about the specific case of 
our solar system. But it does suggest that 
perhaps the solar system might not be 
stable. More important, the finding of¬ 
fers new tools with which to investigate 
the matter 

* Protein folding. The proteins mak¬ 
ing up every living organism are all 
formed as sequences of a large number 
of amino acids, strung out like beads on 
a necklace. Once the beads are put in 
the right sequence, the protein folds up 
rapidly into a highly specific three-di¬ 
mensional structure that determines its 
function in the organism. It has been es¬ 
timated that a supercomputer applying 


PROTEIN-FOLDING PROBLEM con¬ 
siders how a string of amino adds (left) 
folds up almost instantaneously into an 
extraordinarily complex, three-dimension¬ 
al protein (right). Biologists arc now try¬ 
ing to unravel the biochemical “rules” that 
proteins follow in accomplishing this feat. 


plausible rules for protein folding would 
need 10 127 years to find the final folded 
form for even a very short sequence 
consisting of just 100 amino acids. In 
fact, in 1993 Aviezri S. Fraenkel of the 
University of Pennsylvania showed that 
the mathematical formulation of the 
protein-folding problem is computation¬ 
ally “hard” in the same way that the 
traveling-salesman problem is hard, 
I low does nature do it? 

■ Market efficiency. One of the pillars 
on which the classical academic theory 
of finance rests is the idea that financial 
markets are “efficient,” That is, the 
market immediately processes all infor¬ 
mation affecting the price of a stock or 
commodity and incorporates it into the 
current price of the security. Conse¬ 
quently, prices should move in an un¬ 
predictable, essentially random fashion. 
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discounting the effect of inflation. This, 
in turn, means that trading schemes 
based on any publicly available infor¬ 
mation, such as price histories, should 
be useless; there can be no scheme that 
performs better than the market as a 
whole over a significant interval. But ac¬ 
tual markets do not seem to pay much 
attention to academic theory. The fi¬ 
nance literature is filled with such mar¬ 
ket “anomalies” as the low price-earn¬ 
ings ratio effect, which states that the 
stocks of firms whose prices are low rel¬ 
ative to their earnings consistently out¬ 
perform the market overall. 

The Unreality of Mathematics 

O ur examination of the three ques¬ 
tions posed above has yielded what 
appear to be three answers: the solar 
system may not be stable, protein fold¬ 
ing is computationally hard, and finan¬ 
cial markets are probably not complete¬ 
ly efficient* But what each of these pu¬ 
tative “answers” has in common is that 
it involves a mathematical representa¬ 
tion of the real-world question, not the 
question itself* For instance, Xia 3 s solu¬ 
tion of the N-body problem does not 
explain how real planetary bodies move 
in accordance with real-world gravita¬ 
tional forces. Similarly, Fracnkel’s con¬ 
clusion that protein folding is computa¬ 
tionally hard fails to address the issue 
of how real proteins manage to do their 
job in seconds rather than eons. And, 
of course, canny Wall Street operators 
have thumbed their noses at the effi¬ 
cient-market hypothesis for decades* So 
to draw any conclusions about the in¬ 
ability of science to deal with these ques¬ 
tions, we must either justify the mathe¬ 
matical model as a faithful representa¬ 
tion of the physical situation or abandon 
the mathematics altogether* We consid¬ 
er both possibilities in what follows* 
What these examples show is that if 
we want to look for scientifically unan¬ 
swerable questions in the real world, 
we must carefully distinguish between 
the world of natural and human phe¬ 
nomena and mathematical and compu¬ 
tational models of those worlds* The ob¬ 
jects of the real world consist of directly 
observable quantities, such as time and 
position, or quantities, such as energy, 
that are derived from them. Thus, we 
consider parameters such as the mea¬ 



sured position of planets or the actual 
observed configuration of a protein. 
Such observables generally constitute a 
discrete set of measurements taking their 
values in some finite set of numbers. 
Moreover; such measurements are gen¬ 
erally not exact. 

In the world of mathematics, on the 
other hand, we have symbolic represen¬ 
tations of such real-world observables, 
where the symbols arc often assumed 
to belong to a continuum in both space 
and time. The mathematical symbols 
representing attributes such as position 
and speed usually have numerical values 
that are integers, real numbers or com¬ 
plex numbers, all systems containing an 
infinite number of elements* In mathe¬ 
matics the concept of choice for charac¬ 
terizing uncertainty is randomness* 

Finally, there is the world of compu¬ 
tation, which occupies the curious posi¬ 
tion of having one foot in the real world 
of physical devices and one foot in the 
world of abstract mathematical objects. 
If we think of computation as the exe¬ 
cution of a set of rules, or algorithm, the 
process is a purely mathematical one 
belonging to the w orld of symbolic ob¬ 
jects* But if wc regard a computation as 
the process of turning switches on or off 
in the memory of an actual computing 
machine, then it is a process firmly root¬ 
ed in the world of physical observables* 

One way to demonstrate whether a 
given question is logically impossible to 
answer by scientific means is to restrict 
all discussion and arguments solely to 
the world of natural phenomena* If we 
follow this path, we are forbidden to 
translate a question such as “Is the so¬ 
lar system stable?” into a mathematical 
statement and thereby to generate an 
answer with the logical proof mecha¬ 
nism of mathematics. We then face the 
problem of finding a substitute in the 
physical world for the concept of math¬ 
ematical proof* 

A good candidate is the notion of 
causality* A question can be considered 
scientifically answerable, in principle, if 
it is possible to produce a chain of causal 
arguments whose final link is the answer 
to the question* A causal argument need 
not be expressed in mathematical terms* 
For example, the standard deductive ar¬ 
gument “All men are mortal; Socrates is 
a man; therefore, Socrates is mortal” is 
a causal chain. There is no mathematics 


involved, just plain English* On the oth¬ 
er hand, constructing a convincing caus¬ 
al argument without recourse to mathe¬ 
matics may be a daunting task. In the 
case of the stability of tile solar system, 
for example, one must find compelling 
non mathematical definitions of the 
planets and gravity* 

Given these difficulties, it seems wise 
to consider approaches that mix the 
worlds of nature and mathematics* If 
we want to invoke the proof machinery 
of mathematics to settle a particular real- 
world question, it is first necessary to 
“encode” the question as a statement in 
some mathematical formalism, such as 
a differential equation, a graph or an 
N-person game. We settle the mathemat¬ 
ical version of the question using rhe 
tools and techniques of this particular 
comer of the mathematical world, even¬ 
tually “decoding” the answer (if there is 
one!) back into real-world terms* One 
challenge here is establishing that the 
mathematical version of the problem is 
a faithful representation of the question 
as it arises in the real world* How do 
we know that mathematical models of 
a natural system and the system itself 
bear any relation to each other? This is 
an old philosophical conundrum, en¬ 
tailing the development of a theory of 
models for its resolution* Moreover, 
mathematical arguments may be sub¬ 
ject to the constraints revealed by Go- 
del, Turing and Chaitin; we do not know 
yet whether the real world is similarly 
constrained. 

'Hie Non computational Mind 

T here may be ways to sidestep these 
issues* The problems identified by 
Code I and others apply to number sys¬ 
tems with infinite elements, such as the 
set of all integers* But many real-world 
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N-BODY SYSTEM consisting of a point 
mass oscillating between two binary sys¬ 
tems ( left) is unstable, according to a the¬ 
orem by Z hi hong Xia of Northwestern 
University, Such work may reveal wheth¬ 
er the solar system will someday expel 
one of its planets into deep space. 


problems, such as the traveling-sales¬ 
man problem, involve a finite number 
of variables, each of which can take only 
a finite number of possible values. 
Similarly, nondeducrive modes of rea¬ 
soning—induction, for instance, in which 
we jump to a general conclusion on the 
basis of a finite number of specific ob¬ 
servations—can take us beyond the 
realm of logical undecidability. So if we 
restrict our mathematical formalisms to 
systems using finite sets of numbers or 
nondeductive logic, or both, every math¬ 
ematical question should be answer- 
able; hence, we can expect the decoded 
real-world counterpart of such ques¬ 
tions to he answerable as well. 

Studies of the human mind may re¬ 
veal other ways to bypass logical limits. 
Some artificial-intelligence proponents 
have proposed that our brains are com¬ 
puters, albeit extremely sophisticated 
ones, that perform calculations in the 
same logical, step-by-step fashion that 
conventional computers (and even par¬ 
allel processors and neural networks) 
do. But various theorists, notably the 


mathematical physicist Roger Penrose 
of the University of Oxford, have ar¬ 
gued that human cognitive activity is not 
based on any known deductive rules and 
is thus not subject to Godelian limits. 

Recently this viewpoint has been bol¬ 
stered by studies carried out under the 
aegis of the Institute for Future Studies 
in Stockholm by me, the psychologist 
Margaret A, Boden of the University of 
Sussex, the mathematician Donald G. 
Saari of Northwestern University, the 
economist Ake E. Andersson (the insti¬ 
tute's director) and others. Our work 
strongly suggests that in the arts as well 
as in the natural sciences and mathemat¬ 
ics, the human creative capacity' is not 
subject to the rigid constraints of a com¬ 
puter's calculations, Penrose and other 
theorists have conjectured that human 
creativity stems from some still unknown 
mechanisms or rules, perhaps related to 
quantum mechanics. By uncovering 
these mechanisms and incorporating 
them into the scientific method, scien¬ 



tists may be able to solve some seem¬ 
ingly intractable problems. 

Of course, science's ability to plumb 
nature’s secrets is limited by many prac¬ 
tical con side rati on s-^such as measure¬ 
ment error, length of computation, phys¬ 
ical and economic resources, political 
will and cultural values. But none of 
these considerations bears on whether 
there is a logical barrier to our answer¬ 
ing a certain question about the natural 
world. My contention is that diere is not. 
So a tour of 20th-century mathematics 
need not he so disturbing after all! ■ 
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Resolving Zeno’s Paradoxes 

For millennia, mathematicians and philosophers have tried 
to refute Zenos paradoxes, a set of riddles suggesting that motion 
is inherently impossible. At last, a solution has been found 


by William 1. McLaughlin 


O nce upon a time Achilles met a 
tortoise in the road* The tor¬ 
toise, whose mind was quicker 
than his feet, challenged the swift hero 
to a race. Amused, Achilles accepted. 
The tortoise asked if he might have a 
head start, as he was truly much slow¬ 
er than the demigod. Achilles agreed 
happily, and so the tortoise started off. 
After taking quite a bit of time to fasten 
one of his sandal’s ankle straps, Achil¬ 
les bolted from the starting line. In no 
time at all, he ran half the distance That 
separated him from the tortoise. With¬ 
in another blink, he had covered three 
quarters of the stretch. In another in¬ 
stant, he made up seven eighths and in 
another, fifteen sixteenths. But no mat¬ 
ter how fast he ran, a fraction of the 
distance remained. In fact, it appeared 
that the hero could never overtake the 
plodding tortoise. 

Had Achilles spent less time in the 
gym and more time studying philoso¬ 
phy, he would have known that he was 
acting out the classic example used to il¬ 
lustrate one of Zeno’s paradoxes, which 
argue against the possibility of all mo¬ 
tion. Zeno designed the paradox of 
Achilles and the tortoise, and its com¬ 
panion conundra (more about them lat¬ 
er), to support the philosophical theo¬ 
ries of his teacher, Parmenides. 
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Both men were citizens of the Greek 
colony of Elea in southern Italy. In ap¬ 
proximately 445 B.c., Parmenides and 
Zeno met with Socrates in Athens to ex¬ 
change ideas on basic philosophical 
issues. The event, one of the greatest 
recorded intellectual encounters (if it 
really took place), is commemorated in 
Plato’s dialogue Parmenides. Parmen¬ 
ides, a distinguished thinker nearly 65 
years old, presented to the young Soc¬ 
rates a startling thesis; "reality 11 is an 
unchanging single entity, seamless in 
its unity. The physical world, he argued, 
is monolithic* In particular, motion is 
not possible. Although the rejection of 
plurality and change appears idiosyn¬ 
cratic, it has, in general outline, proved 
attractive to numerous scholars. For ex¬ 
ample, the "absolute idealism" of the 
Oxford philosopher F. R Bradley (1846- 
1924) has points in common with the 
Parmenidean outlook. 

Phis portrayal of the world is contrary 
to our everyday experience and rele¬ 
gates our most fundamental percep¬ 
tions lo the realm of illusion. Parmen¬ 
ides relied on Zeno’s powerful argu¬ 
ments, which w r ere later recorded in the 
writings of Aristotle, to support his case. 
For iwo and a half millennia, Zeno’s 
paradoxes have provoked debates and 
stimulated analyses. At last, using a 
formulation of calculus that was devel¬ 
oped in just the past decade or so, it is 
possible to resolve Zeno’s paradoxes. 
The resolution depends on the concept 
of infinitesimals, known since ancient 
times but until recently viewed by many 
thinkers with skepticism. 

T he tale of Achilles and the tortoise 
depicts one of Zeno’s paradoxes, 
usually denoted “The Dichoto¬ 
my": any distance, such as that between 
the two contenders, over which an ob¬ 
ject must traverse can be halved 0/z , 
V4, J A and so on) into an infinite num¬ 
ber of spatial segments, each represent¬ 
ing some distance yet to be traveled. 
As a result, Zeno asserts that no motion 
can be completed because some dis¬ 


tance, no matter how f small, always re¬ 
mains. It is important to note that he 
does not say that infinitely many stretch¬ 
es cannot add up to a finiLe distance 
(glancing at the geometry of an infi¬ 
nitely partitioned line show’s immedi¬ 
ately, without any sophisticated calcula¬ 
tions, that an infinite number of pieces 
sum to a finite interval)* Rather the force 
of Zeno’s objection to the idea of mo¬ 
tion comes from the obligation to ex¬ 
plain bow r an infinite number of acts— 
crossing one interval—can be serially 
completed. 

Zeno made a second attack on the 
conceptual underpinnings of motion 
by viewing ihis first argument from a 
slightly different perspective* His sec¬ 
ond paradox is as follows: Before an 
object, say, an arrow', gets to the half¬ 
way mark of its supposed journey (an 
achievement granted in the preceding 
case), ti must first travel a quarter of 
the distance* As in Zeno’s first objec¬ 
tion, this reasoning can be continued 
indefinitely to yield an infinite regress, 
thus leading to his insistence that mo¬ 
tion could never be initiated. 

Zeno’s Lhird paradox lakes a different 
lack altogether, it asserts that the very 
concept of motion is empty of content. 
Zeno invites us to consider the arrow 
at any one instant of its flight. At this 
point in time, the arrow occupies a re¬ 
gion of space equal to its length, and no 
motion whatsoever is evident. Because 
this observation is true at every instant, 
the arrow is never in motion. This ob¬ 
jection, in a historical sense, proved 
the most troublesome for w'ould-be 
explainers of Zeno’s paradoxes. 

Many philosophers and mathemati¬ 
cians have made various attempts to 
answer Zeno’s objections. The most di¬ 
rect approach has simply been to deny 
that a problem exists. For example, Jo¬ 
hann Gottlieb Waldin, a German profes¬ 
sor of philosophy, wrote in 1782 that 
the Eleatic, in arguing against motion, 
assumed that motion exists. Evidently 
the good professor was not acquainted 
with the form of argument known as 
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reductio ad absurdum: assume a state 
of affairs and then show that it leads to 
an illogical conclusion. 

Nevertheless, other scholars made 
progress by wrestling with how an in¬ 
finite number of actions mighL occur in 
the physical world. Their explanations 
have continually been intertwined with 
the idea of an infimtesimai, an interval 
of space or time that embodies the 
quintessence of smallness. An infini¬ 
tesimal quantity, some surmised, would 
be so very near zero as to be numeri¬ 
cally impotent; such quantities would 
elude aU measurement, no matter how 
precise, like sand through a sieve. 

Giovanni Benedetti (1530-1590), a 
predecessor of Galileo, postulated that 
when an object appeared to be frozen 
in midair to Zeno, he was in fact seeing 
only part of the action, as though one 
were watching a slide show r instead of a 
movie. Between the static images Zeno 
saw were infinitesimally small instants 
of time in which the object moved by 
equally small distances. 

Others sidestepped the issue by ar- 
guing that intervals in the physical world 
cannot simply be subdivided an infinite 
number of times. Friedrich Adolf Tren¬ 
delenburg (1802-1872) of the Universi¬ 
ty of Berlin built an entire philosophical 
system that explained human percep¬ 
tions in terms of motion. In doing so, 
he freed himself from explaining mo¬ 
tion itself. 

Similarly, in this century, the English 
philosopher and mathematician .Alfred 
North Whitehead (1861-1947) con¬ 
structed a system of metaphysics based 
on change, in which motion w ? as a spe¬ 
cial case. Whitehead responded to 
Zeno’s objections by insisting that 
events in the physical world had to 
have some extent; namely, they could 
not be point like. Likewise, the Scottish 
philosopher David Hume (1711-1776) 
wrote, 7411 the ideas of quantity upon 
which mathematicians reason, arc noth¬ 
ing hut particular, and such as are sug¬ 
gested by the senses and imagination 


FALLING APPLE? Zeno would argue that 
because the apple appears to be frozen 
in midair at each instant of its sup¬ 
posed descent, it is never in motion. 
Moreover, Zeno would assert that there 
is no proof that the apple will ever reach 
the ground. Before it arrives there, it 
must first fall half of the distance be¬ 
tween the man's hand and the ground. 
After that, it must fall half of the re¬ 
maining distance and half of that again, 
and so on. How can it be that some frac¬ 
tional distance does not always remain 
between the apple and the ground? Us¬ 
ing similar logic, Zeno would question 
whether an apple can even begin to fall. 
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RACE between Achilles and the tonoise illustrates one of Zeno's paradoxes. Achilles 
gives the tortoise a head start. He must then make up half the distance between 
them, then three fourths, then seven eighths and so on, ad infinitum. In this way, it 
would seem he could never come abreast of the sluggish animal 


and consequently, cannot be infinitely 
divisible.” 

Either way, the subject of infinitesi¬ 
mals (and whether they exist or not) 
generated a long and acrimonious liter¬ 
ature of its own. Uncii recently, most 
mathematicians thought them to be a 
chimera. The Irish bishop George Ber¬ 
keley (1685-1753) is noted principally 
for his idealistic theory, which denied 
the reality of matter, but he, too, wres¬ 
tled with infinitesimals. He believed 
them 01 conceived by the mathemati¬ 
cians of the time, including Newton. 
“They are neither finite quantities, nor 
quantities infinitely small, nor yet noth¬ 
ing. May w r e not call them ghosts of de¬ 
parted quantities?” He observed fur¬ 
ther: “Whatever mathematicians may 
think of fluxions [rates of change], or 
the differential calculus, and the like, a 
little reflexion will shew them that, in 
working by those methods, they do not 
conceive or imagine lines or surfaces 
less than what are perceivable to sense. 1 ' 

Indeed, mathematicians found infin¬ 
itesimals hard to skirt in the course of 
their discoveries, no matter how dis¬ 
tasteful they found them in theory. 
Some historians believe the great Archi¬ 
medes (circa 287-212 B.c.) achieved 
some of his mathematical results using 
infinitesimals but employed more con¬ 
ventional modes for public presenta¬ 


tions. Infinitesimals left their mark dur¬ 
ing the 17th and 18th centuries as well 
in the development of differential and 
integral calculus. Elementary textbooks 
have long appealed to “practical infi¬ 
nitesimals" to convey certain ideas in 
calculus to students. 

When analysts thought about rigor¬ 
ously justifying the existence of these 
small quantities, innumerable difficul¬ 
ties arose. Eventually, mathematicians 
of the 19th century invented a techni¬ 
cal substitute for infinitesimals: the so- 
called theory' of limits. So complete was 
its triumph that some mathematicians 
spoke of the “banishment 11 of infinites¬ 
imals from their discipline. By the 
1960s, though, the ghostly tread of in¬ 
finitesimals in the corridors of mathe¬ 
matics became quite real once more, 
thanks to the work of the logician Abra¬ 
ham Robinson of Yale University [see 
“Nonstandard Analysis," by Martin Da¬ 
vis and Reuben Ifersh; Scientific Amer¬ 
ican, June 1972]. Since then, several 
methods in addition to Robinson's ap¬ 
proach have been devised that make 
use of infini tesimals. 

W hen my colleague Sylvia Miller 
and I started our work on 
Zeno’s paradoxes, we had the 
advantage that infinitesimals had be¬ 
come mathematically respectable. We 


w 7 ere intuitively drawn to these objects 
because they seem to provide a micro¬ 
scopic view of the details of motion. 
Edward Nelson of Princeton University 
created the tool w ? e found most valu¬ 
able in our attack, a brand of nonstan¬ 
dard analysis known by the rather arid 
name of internal set theory (1ST). Nel¬ 
son's method produces startling inter¬ 
pretations of seemingly familiar math¬ 
ematical structures. The results are 
similar, in their strangeness, to the 
structures of quantum theory and gen¬ 
eral relativity 7 in physics. Because these 
two theories have taken the better part 
of a century to gain widespread accep¬ 
tance, we can only admire the power of 
Nelson's imagination. 

Nelson adopted a novel means of 
defining infinitesimals. Mathematicians 
typically expand existing number sys¬ 
tems by tacking on objects that have 
desirable properties, much in the same 
way that fractions w 7 ere sprinkled be¬ 
tween the integers. Indeed, the number 
system employed in modem mathe¬ 
matics, like a coral reef, grew by accre¬ 
tion onto a supporting base: “God made 
the integers, all the rest is the work of 
man,” declared Leopold Kronecker 
(1823-1891). Instead the way of 1ST is 
to “stare” very hard at the existing num¬ 
ber system and note that it already con¬ 
tains numbers that, quite reasonably, 
can be considered infinitesimals. 

Technically. Nelson finds nonstan¬ 
dard numbers on the real line by add¬ 
ing three rules, or axioms, to the set of 
10 or so statements supporting most 
mathematical systems. (Zermelo-Fraen- 
kel set theory is one such foundation.) 
These additions introduce a new term, 
standard, and help us to determine 
which of our old friends in the number 
system are standard and which are non¬ 
standard. Not surprisingly, die infinites¬ 
imals fall in the nonstandard category, 
along with some other numbers I will 
discuss later. 

Nelson defines an infinitesimal as a 
number that lies between zero and ev¬ 
ery 7 positive standard number. At first, 
this might not seem to convey any par¬ 
tial lar notion of smallness, but Lhe 
standard numbers include every con¬ 
crete number (and a few 7 others) you 
could write on a piece of paper or gen¬ 
erate in a computer: 10, pi, Viono and 
so on. Hence, an infinitesimal is greater 
than zero but less than any number, 
however small, you could ever conceive 
of writing. It is not immediately appar¬ 
ent that such infinitesimals do indeed 
exist, but the conceptual validity of 1ST 
has been demonstrated to a degree 
commensurate with our justified belief 
in other mathematical systems. 

Still, infinitesimals are truly elusive 
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entities. Their elusiveness rests on the 
mathematical fact that two concrete 
numbers—those having numerical con¬ 
tent—cannot differ by an infinitesimal 
amount. The proof, by reductio ad ab- 
surdum, is easy: the arithmetic differ¬ 
ence between two concrete numbers 
must be concrete (and hence, standard). 
If this difference were infinitesimal, the 
definition of an infinitesimal as less 
than all standard numbers would be vi¬ 
olated. The consequence of this fact is 
that both end points of an infinitesimal 
interval cannot be labeled using con¬ 
crete numbers. Therefore, an infinitesi¬ 
mal interval can never be captured 
through measurement; infinitesimals 
remain forever beyond the range of 
observation, 

S o how can these phantom num¬ 
bers be used to refute Zeno's para¬ 
doxes? From the above discus¬ 
sion it is dear that the points of space 
or time marked with concrete numbers 
are but isolated points. A trajectory and 
its associated time interval are in fact 
densely packed with infinitesimal re¬ 
gions, As a result, we can grant Zeno's 
third objection: the arrow's tip is caught 
“stroboseoplcally" at rest at concretely 
labeled points of time, but along the 
vast majority of the stretch, some kind 
of motion is taking place. This motion 
is immune from Zenonian criticism be¬ 
cause it is postulated to occur inside 
infinitesimal segments. Their ineffabili- 
ty provides a kind of screen or filter. 
Might the process of motion inside 
one of these intervals be a uniform ad¬ 
vance across the interval or an instan¬ 
taneous jump from one end to the oth¬ 


er? Or could motion comprise a series 
of intermediate steps or dse a process 
outside of time and space altogether? 
The possibilities are infinite, and none 
can be verified or ruled out since an in¬ 
finitesimal interval can never be moni¬ 
tored. Credit for this rebuttal is due to 
Benedetti, Trendelenburg and White- 
head for their earlier insights, which can 
now be formalized by means of 1ST, 

We can answer Zeno's first two objec¬ 
tions more easily than we did the third, 
but we need to use another mathemati¬ 
cal fact from 1ST. Every infinite set of 
numbers contains a nonstandard num¬ 
ber, Before drawing out the Zenonian 
implications of this statement, it is nec¬ 
essary to talk about the two other types 
of nonstandard numbers that are read¬ 
ily manufactured from infinitesimal 
numbers. First, take ad the infinitesi¬ 
mals, which by definition are wedged 
between zero and all the positive, stan¬ 
dard numbers, and put a minus sign 
in front of each one. Now there is a 
symmetrical clustering of these small 
objects about zero. To create “mixed” 
nonstandard numbers, take any stan¬ 
dard number, say, one half, and add to 
it each of the nonstandard infinitesi¬ 
mals m the grouping around zero. This 
act of addition translates the original 
duster of infinitesimals to positions on 
either side of one half. Similarly, every 
standard number can be viewed as hav¬ 
ing its own collection of nearby, non¬ 
standard numbers, each one only an 
infinitesimal distance from the stan¬ 
dard number. 

The third type of nonstandard num¬ 
ber is simply the inverse of an infinites¬ 
imal. Because an infinitesimal is very 


small, its inverse will be very large (in 
the standard realm, the inverse of one 
millionth Is one million). This type of 
nonstandard number is called an un¬ 
limited number. The unlimited num¬ 
bers, though large, are finite and hence 
smaller than the truly infinite numbers 
created in mathematics. 'Ihese unlimit¬ 
ed numbers live in a kind of twilight 
zone between the familiar standard 
numbers, which are finite, and the in¬ 
finite ones. 

If, as demonstrated in 1ST, every in¬ 
finite set contains a nonstandard num¬ 
ber, then the infinite series of check¬ 
points Zeno used lo gauge motion in his 
first argument must contain a mixed, 
nonstandard number. In fact, as Zeno’s 
infinite series of numbers creeps closer 
to one, a member of that series will 
eventually be within an infinitesimal dis¬ 
tance from one. At that point, all suc¬ 
ceeding members of the series will be 
nonstandard members of the cluster 
about one, and neither Zeno nor anyone 
else will be able to chart the progress 
of a moving object in this inaccessible 
region. 

T here is an element of irony in us¬ 
ing infinity, Zeno's putative weap¬ 
on, to deflate his claims. To re¬ 
fute Zeno’s first paradox, we need only 
state the epistemological principle that 
we are not responsible for explaining 
situations we cannot observe. Zeno's 
infinite series of checkpoints contains 
nonstandard numbers, which have no 
numerical meaning, and so we reject 
his argument based on these entities. 
Because no one could ever, even in prin¬ 
ciple, observe the full domain of dieck- 



T^he real numbers consist of the integers (positive and 
X negative whole numbers), rational numbers (those 
that can be expressed as a fraction) and irrational num¬ 
bers (those that cannot be expressed as a fraction). The 
real numbers can be represented as points on a straight 
line known as the real line (above). 

The mathematician Edward Nelson of Princeton Univer¬ 
sity labeled three types of numbers as nonstandard with¬ 
in this standard number system. Infinitesimal nonstandard 
numbers are smaller than any positive standard number 


yet are greater than zero. Mixed nonstandard numbers, 
shown grouped around the integer 5, result from adding 
and subtracting infinitesimal amounts to standard num¬ 
bers. In fact, every standard number is surrounded by 
such mixed, nonstandard neighbors. Unlimited nonstan¬ 
dard numbers, represented as N and N + 1, are the invers¬ 
es of infinitesimal nonstandard numbers. Each unlimited 
number is greater than every standard number and yet 
less than the infinite real numbers. The nonstandard real 
numbers prove useful in resolving Zeno’s paradoxes. 
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points that his objection addresses, the 
objectionable behavior he postulates for 
the moving object is moot. Many de¬ 
scriptions of motion in the microreaim 
other than that containing the full se¬ 
ries of checkpoints could apply, and 
just because his particular scenario 
causes conceptual problems, there is 
no reason to anathematize the idea of 
motion. His second argument, attempt¬ 
ing to show that an object can never 
even start to move, suffers from the 
same malady as the first, and we reject 
it on like grounds. 

W e have resolved Zeno's three 
paradoxes using some techni¬ 
cal results from 1ST and the 
principle that nonstandard numbers 
are not suitable for describing matters 
of fact, observed or purported. Still, 
more can be said regarding the matter 
than just the assurance that Zeno's ob¬ 
jections do not preclude motion. In¬ 
deed, we can construct a theory of mo¬ 
tion using a very powerful result from 
1ST. The theory yields the same results 
as do the tools of the calculus, and yet 
it is easier to visualize and does not fall 
prey to Zeno's objections. 

A theorem proved in 1ST states that 
I here exists a finite set, call it F, that 
contains all the standard numbers! The 
corollary that there are only a finite 


number of standard numbers would 
seem to be true, but surprisingly, it is 
not. In developing 1ST, Nelson needed 
to finesse the conventional way mathe¬ 
maticians form objects. A statement in 
1ST is called internal if it does not con¬ 
tain the label “standard.” Otherwise, the 
statement is called external. Mathema¬ 
ticians frequently create subsets from 
larger sets by predicating a quality that 
characterizes each of the objects in the 
subset—the balls that arc red or the in¬ 
tegers that are even* In 1ST, however, it 
is forbidden to use external predicates, 
such as standard, to define subsets; the 
stricture is introduced to avoid contra¬ 
dictions. For example, imagine the set 
of all standard numbers in F. This set 
would be finite because it is a subset of 
a finite set. it would therefore have a 
least member, say, r. But then r - 1 
would be a standard number less than 
r, when rwas supposed to be the small¬ 
est standard number. Thus, we cannot 
say the standard numbers are finite or 
infinite in extent, because we cannot 
form the set of them and count them. 

Nevertheless, the finite set F, though 
constrained as to how it can be visual¬ 
ized, is useful for constructing our the¬ 
ory of motion. This theory' can be ex¬ 
pressed quite simply as stepping 
through F, where each member of F 
represents a distinct moment. For con¬ 


venience, consider only those members 
of F that tall between 0 and 1. Let time 
0 be the instant when we start tracking 
a moving object. The second instant 
when we might try to observe the ob¬ 
ject is at time f it where f\ is the small¬ 
est member of F that is greater than 0. 
Ascending through F in this fashion, 
we eventually reach time f n , where f n is 
the largest member of F less than 1. In 
one more step, we reach 1 itself, the 
destination in this example. In order to 
w r alk through a noninfinitcsimal dis¬ 
tance, such as the span from 0 to 1 us¬ 
ing infinitesimal steps, the subscript 
n of f n must be an unlimited integer. 
The process of motion then is divided 
into n + 1 acts, and because n +1 is 
also finite, this number of acts can be 
completed sequentially. 

Of the possible observing times iden¬ 
tified earlier, the object's progress could 
be reported solely at those instants 
corresponding to certain standard num¬ 
bers in F. (By the way, f] and f n would 
be nonstandard, as they are infinitesi¬ 
mally close to 0 and 1, respectively.) For 
example, although wc can express a 
standard number to any finite (but not 
unlimited) number of decimal places 
and use this approximation as a mea¬ 
surement label, we cannot access the 
unlimited tail of the expansion to alter 
a digit and ihus define a nonstandard, 


T o see the relation between 
infinitesimals and differen¬ 
tial calculus, consider the sim¬ 
ple case of a falling stone. The 
distance the stone has traveled 
in feet can be calculated from 
the formula s - 16t 2 t where r 
equals the time elapsed in sec¬ 
onds. For example, if a stone 
has fallen for two seconds, it 
will have traveled 64 feet. 

Suppose, however, one wish¬ 
es to calculate the instantane¬ 
ous velocity of the stone. The 
average speed of a moving ob¬ 
ject equals the total distance it travels divided by the total 
amount of time it takes. By using this formula over an in¬ 
finitesimal change in the total distance and time, one can 
calculate a fair approximation of an object's instanta¬ 
neous velocity. 

Let dt represent an infinitesimal change in time and ds 
an infinitesimal change in distance. The computation for 
the velocity of the stone after one second of travel, then, 
will be as follows: The time frame under consideration 
ranges from f - 1 to f = / + dr. The position of the stone 
during that time changes from s = 16( 1) 2 to 5 = 16(1 + dt) 2 . 
The total change in distance, 32dt+ 16dt 2 , divided by dt f 


is the desired average velocity, 
32 + 1 6dL 

Because ]6dt is but an infi¬ 
nitesimal amount, undetectable 
for all intents and purposes, it 
can be considered equal to 0. 
Thus, after one second of travel, 
the formula yields the stone's 
instantaneous velocity as 32 
feet per second. 

This manipulation, of course, 
resembles those used in tra¬ 
ditional, differential calculus. 
There the small residue 16z/t 
cannot be dropped at the end 
of the calculation; it is a noninfinitesimal quantity. Instead, 
in this calculus, it must be argued away using the theory 
of limits. In essence, the limit process renders the interval 
of length dt sufficiently small so that the average velocity 
is arbitrarily close to 32. As before, the instantaneous ve¬ 
locity of the stone after one second of travel equals 32 
feet per second. Similarly, judicious use of infinitesimal re¬ 
gions facilitates the computation of the area of complicat¬ 
ed regions, a basic problem of integral calculus. Some 
think the newer calculus is pedagogically superior to cal¬ 
culus without infinitesimals. Nevertheless, both methods 
are equally rigorous and yield identical results. 


Calculus by Means of Infinitesimals 
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THE MEASt/RERS, a 17 th-century Dutch painting attributed rise measurements become, however, infinitesimal amounts 
to Hendrik van Baien, illustrates the words of the Roman poet will forever escape our grasp, since any useful unit of mea- 
Horace: “There is measure in all things,’ 1 No matter how pre- sure must correspond to some standard number. 


infinitesimally dose neighbor. Only con¬ 
crete standard numbers arc effective as 
measurement labels; the utility of their 
nonstandard neighbors for measure¬ 
ment is illusory, 

M uch is superfluous in this theo¬ 
ry of motion, and much is left 
unsaid. It suffices, however, in 
the sense that it can easily be translat¬ 
ed into the symbolic notation of the in¬ 
tegral or differential calculus, common¬ 
ly used to describe the details of motion 
[see box on opposite page]. More impor¬ 
tant in the present context, the iinite- 
ness of the set F enables ns to jump 
over the pitfalls in Zeno's first two para¬ 
doxes. His third objection is dodged as 
before: motion in real time is an un¬ 
known process that takes place in in¬ 
finitesimal intervals between the stan¬ 
dard points of F; the nonstandard points 
of F are irrelevant given that they can¬ 
not he observed. 

For many centuries, Zeno's logic stood 
mostly intact, proving the refractory na¬ 
ture of his arguments. A resolution was 
made possible through two basic fea¬ 
tures of 1ST: first, the ability to partition 
an interval of time or space into a finite 
number of ineffable infinitesimals and, 
second, the fact that standardly labeled 
points—the only ones that can be used 
for measurement—are isolated objects 
on the real line. Is our work merely the 


solution to an ancient puzzle? Possibly, 
but there are several directions in which 
it might prove extensible. 

Aside from its mathematical value, 
1ST is ripe with epistemological import, 
as this analysis has shown. It might 
well be modified to constitute a general 
cpistcmic logic. Also, infinitesimal in¬ 
tervals, or their generalization, would 
promise a technical resource to house 
Whitehead's so-called actual entities, 
the generative atoms of his philosophi¬ 
cal system. Finally, the current theory 
of motion and the predictions of quan¬ 
tum physics are not dissimilar in that 
they both restrict the observation of cer¬ 
tain events to discrete values, Of course, 
this theory of motion is not a version 
of quantum mechanics (nor relativity 
theory, for that manor). Because the 
theory resulted from a thought experi¬ 
ment on Zeno’s terms, it holds no di¬ 
rect connection to present physical the¬ 
ory. Moreover, the specific rules inher¬ 
ited from 1ST are probably not those 
best suited to describe reality. Modem 
physics might adapt the 1ST approach 
by modifying its rule system and Intro¬ 
ducing “physical constants," perhaps 
by assigning parameters to the set F. 

But maybe not. Still, the simplicity 
and elegance of such thought experi¬ 
ments have catalyzed research through¬ 
out the ages. Notable examples include 
Heinrich W. M. Gibers, questioning why 


the sky is dark at night despite stars in 
every direction, or James Clerk Maxwell, 
summoning a meddling, microscopic 
demon to batter the second law of ther¬ 
mo dynamics. Likewise, Zeno’s argu¬ 
ments have stimulated examinations of 
our ideas about motion, time and space. 
The path to their resolution has been 
eventful. 
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